-- Logs begin at Fri 2022-08-19 14:36:37 UTC, end at Fri 2022-08-19 15:36:42 UTC. -- Aug 19 15:07:58.907182 dv-cinder-835384-20-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 15:07:58.915296 dv-cinder-835384-20-smb devstack@keystone.service[81443]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 15:07:58.917845 dv-cinder-835384-20-smb devstack@keystone.service[81443]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 15:07:58 2022] *** Aug 19 15:07:58.917970 dv-cinder-835384-20-smb devstack@keystone.service[81443]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 15:07:58.918110 dv-cinder-835384-20-smb devstack@keystone.service[81443]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 15:07:58.918220 dv-cinder-835384-20-smb devstack@keystone.service[81443]: nodename: dv-cinder-835384-20-smb Aug 19 15:07:58.918220 dv-cinder-835384-20-smb devstack@keystone.service[81443]: machine: x86_64 Aug 19 15:07:58.918220 dv-cinder-835384-20-smb devstack@keystone.service[81443]: clock source: unix Aug 19 15:07:58.918220 dv-cinder-835384-20-smb devstack@keystone.service[81443]: pcre jit disabled Aug 19 15:07:58.918220 dv-cinder-835384-20-smb devstack@keystone.service[81443]: detected number of CPU cores: 4 Aug 19 15:07:58.918220 dv-cinder-835384-20-smb devstack@keystone.service[81443]: current working directory: / Aug 19 15:07:58.918220 dv-cinder-835384-20-smb devstack@keystone.service[81443]: detected binary path: /usr/bin/uwsgi-core Aug 19 15:07:58.918220 dv-cinder-835384-20-smb devstack@keystone.service[81443]: your processes number limit is 47680 Aug 19 15:07:58.918220 dv-cinder-835384-20-smb devstack@keystone.service[81443]: your memory page size is 4096 bytes Aug 19 15:07:58.918220 dv-cinder-835384-20-smb devstack@keystone.service[81443]: detected max file descriptor number: 2048 Aug 19 15:07:58.918760 dv-cinder-835384-20-smb devstack@keystone.service[81443]: lock engine: pthread robust mutexes Aug 19 15:07:58.918760 dv-cinder-835384-20-smb devstack@keystone.service[81443]: thunder lock: enabled Aug 19 15:07:58.918760 dv-cinder-835384-20-smb devstack@keystone.service[81443]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 15:07:58.918760 dv-cinder-835384-20-smb devstack@keystone.service[81443]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 15:07:58.958401 dv-cinder-835384-20-smb devstack@keystone.service[81443]: Python main interpreter initialized at 0x55b755b9c9c0 Aug 19 15:07:58.958401 dv-cinder-835384-20-smb devstack@keystone.service[81443]: python threads support enabled Aug 19 15:07:58.958401 dv-cinder-835384-20-smb devstack@keystone.service[81443]: your server socket listen backlog is limited to 100 connections Aug 19 15:07:58.958401 dv-cinder-835384-20-smb devstack@keystone.service[81443]: your mercy for graceful operations on workers is 90 seconds Aug 19 15:07:58.958723 dv-cinder-835384-20-smb devstack@keystone.service[81443]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 15:07:58.958802 dv-cinder-835384-20-smb devstack@keystone.service[81443]: *** Operational MODE: preforking *** Aug 19 15:07:58.959077 dv-cinder-835384-20-smb devstack@keystone.service[81443]: *** uWSGI is running in multiple interpreter mode *** Aug 19 15:07:58.959077 dv-cinder-835384-20-smb devstack@keystone.service[81443]: spawned uWSGI master process (pid: 81443) Aug 19 15:07:58.959262 dv-cinder-835384-20-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 19 15:07:58.962963 dv-cinder-835384-20-smb devstack@keystone.service[81443]: spawned uWSGI worker 1 (pid: 81449, cores: 1) Aug 19 15:07:58.962963 dv-cinder-835384-20-smb devstack@keystone.service[81443]: spawned uWSGI worker 2 (pid: 81450, cores: 1) Aug 19 15:07:58.962963 dv-cinder-835384-20-smb devstack@keystone.service[81443]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 15:08:03.221271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:08:03.221271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: from cryptography.utils import int_from_bytes Aug 19 15:08:03.222089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:08:03.222089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: from cryptography.utils import int_from_bytes Aug 19 15:08:03.222504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:08:03.222504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: from cryptography.utils import int_from_bytes Aug 19 15:08:03.222611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 15:08:03.222611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: from cryptography.utils import int_from_bytes Aug 19 15:08:03.272648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 15:08:03.272844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 15:08:03.272942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 15:08:03.273027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] command line args: [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 15:08:03.273103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 15:08:03.273239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] command line args: [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 15:08:03.273323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 15:08:03.273469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ================================================================================ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 15:08:03.273546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 15:08:03.273678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ================================================================================ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 15:08:03.273755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] admin_token = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.273937 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] admin_token = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.274046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_dir = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.274164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.274251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_dir = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.274351 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] config_source = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.274427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.274534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] debug = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.274622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] config_source = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.274728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] debug = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.274803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.274994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.275090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.275155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.275290 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.275397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.275522 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.275625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.275776 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.275892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.276012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.276114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.276214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_config_append = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.276309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_config_append = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.276419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.276521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.276633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_dir = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.276735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_dir = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.276844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.276957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.277089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.277204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.277283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.277398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.277398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.277577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.277658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.277736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.277853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.277927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.278079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.278170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.278248 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.278366 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.278480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.278600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.278722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.278842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.278955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.279066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.279181 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.279298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.279419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.279542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.279661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.279777 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.279895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.280007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.280119 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.280244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.280611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.280722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.280830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] publish_errors = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.280942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] publish_errors = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.281053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.281164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.281279 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.281401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.281514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.281631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.281744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.281872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.281994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.282129 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.282242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] standard_threads = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.282355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] standard_threads = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.282467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.282590 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.282711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.282831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.282945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.283057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.283175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_journal = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.283349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_journal = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.283467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_json = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.283586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_json = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.283700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_stderr = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.283812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_stderr = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.283930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] use_syslog = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.284051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] use_syslog = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.284164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.284276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 15:08:03.284389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.284501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.284613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.284732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.284845 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.284957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.285075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.285193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.285306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.285425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.285546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.285659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.285771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.285882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.285994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.286144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.286265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.286380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.286499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.286618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.286731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.286857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.286976 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.287090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.287209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.287321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.287433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.287561 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.287676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.287788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.287899 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.288011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.288128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.288249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.288369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.288482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.288602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.288715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.288905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.289021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.289139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.289251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.289363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.289475 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.289595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.289715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.289828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.289945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.290088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.290205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.290329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.290444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.290556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.290667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.290780 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.290881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.291000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.291120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.291239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.291352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.291464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.291576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.291699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.291814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.291931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.292044 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.292156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.292275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.292396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.292510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.292628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.292740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.293096 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.293216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.293338 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.293451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.293563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.293680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.293800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.293913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.294059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.294175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.294287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.294399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.294511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.294623 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.294813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.294930 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.295042 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.295154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.295272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.295386 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.295506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.295620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.295732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.295844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.295956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.296067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.296188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.296301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.296418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.296538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.296657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.296770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.296897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.297013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.297130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.297249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.297369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.297465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.297567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.297662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.297756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.297887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.297991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.298149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.298249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.298344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.298440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.298564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.298668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.298788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.298903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.299005 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.299118 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.299239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.299353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.299478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.299593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.299717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.299838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.299942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.300054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.300167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.300280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.300401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.300521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.300521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.300719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.300719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.300929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.301053 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.301168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.301168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.301378 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.301486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.301599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.301720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.301834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.301947 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.302095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.302211 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.302334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.302458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.302572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.302687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.302806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.302921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.303034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.303158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.303274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.303393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.303507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.303620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.303739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.303861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.303976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.303976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.304186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.304186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.304398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.304519 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.304633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.304745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.304858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.304970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.305089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.305215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.305336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.305451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.305564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.305677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.305795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.305984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.306142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.306257 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.306380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.306496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.306619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.306742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.306869 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.306983 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.307096 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.307209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.307329 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.307443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.307569 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.307684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.307797 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.307910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.308066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.308189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.308311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.308425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.308539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.308652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.308764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.308876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.external = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.309006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.309153 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.309269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.external = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.309383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.309497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.309638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.309766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.309891 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.password = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.310014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.310197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] auth.token = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.310316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.password = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.310430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.310545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] auth.token = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.310660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.310786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.310903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.311499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.311621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.311738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.311852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.311978 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.312100 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.312216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.312330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.312444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.312558 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.312679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.312796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.312916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.313031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.313145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.313259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.313381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.313497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.313617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.313732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.313846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.313966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.314130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.314255 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.314371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.314485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.314599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.314714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.314838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.314962 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.315078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.315193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.315307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.315421 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.315543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.315692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.315809 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.315924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.316038 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.316151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.316274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.316390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.316504 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.316618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.316769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.316892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.317017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.317133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.317247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.317361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.317475 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.317597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.317714 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.317828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.317943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.318071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.318187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.318312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.318429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.318543 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.318658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.318772 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.318886 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.319009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.319125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.319239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.319352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.319466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.319580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.319701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.319816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.319930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.320045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.320168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.320282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.320469 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.320587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.320701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.320815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.320928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.321042 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.321165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.321281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.321394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.321508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.321622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.321736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.321859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.321981 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.322138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.322255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.322370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.322484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.322607 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.322722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.322843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.322958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.323072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.323187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.323309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.323426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.323540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.323654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.323768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.323882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.324004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.324119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.324233 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.324347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.324460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.324574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.324696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.324812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.324926 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.325039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.325160 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.325275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.325398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.325514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.325629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.325743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.325857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.325970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.326110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.326228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.326342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.326456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.326570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.327274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.327394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.327509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.327624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.327738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.327852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.327974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.328089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.328203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.328317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.328432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.328546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.328668 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.328783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.328897 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.329011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.329125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.329246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.329450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.329574 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.329688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.329802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.329922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.330066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.330200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.330317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.330431 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.330555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.330688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.330804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.330927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.331042 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.331156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.331270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.331383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.331498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.331621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.331737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.331851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.331964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.332079 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.332192 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.332314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.332429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.332543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.332648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.332761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.332875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.332996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.333111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.333225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.333338 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.333451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.333565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.333687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.333803 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.333917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.334049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.334166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.334281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.334406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.334523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.334637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.334752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.334872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.334987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.335114 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.335230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.335345 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.335464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.335579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.335693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.335817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.335933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.335933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.336147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.336262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.336375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.336497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.336619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.336734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.336849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.336963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.337084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.337210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.337326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.337444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.337558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.337672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.337785 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.337908 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.338039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.338157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.338271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.338385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.338498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.338624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.338740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.338854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.338970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.339084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.339198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.339321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.339437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.339551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.339665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.339778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.339892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.340015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.340131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.340245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.340364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.340479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.340593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.340715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.340831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.340945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.341060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.341174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.341288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.341410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.341526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.341640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.341744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.341857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.341979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.342141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.342794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.342915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.343029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.343144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.343271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.343388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.343509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.343624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.343738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.343852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.344039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.344157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.344272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.344386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.344501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.344615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.344739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.344854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.344968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.345083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.345198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.345312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.345434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.345660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.345783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.345899 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.346013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.346147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.346275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.346392 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.346506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.346621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.346735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.346850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.346972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.347088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.347206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.347206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.347423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.347538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.347660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.347660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.347876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.347990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.348104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.348217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.348339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.348457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.348571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.348685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.348799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.348921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.349037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.349152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.349266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.349380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.349495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.349617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.349733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.349848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.350138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.350261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.350376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.350506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.350624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.350739 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.350854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.350969 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.351083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.351206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.351322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.351436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.351552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.351666 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.351781 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.351903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.352019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.352134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.352249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.352363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.352478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.352602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.352718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.352833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.352948 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.353063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.353177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.353301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.353423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.353540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.353656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.353770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.353884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.354007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.354140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.354256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.354371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.354486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.354600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.354727 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.354844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.355205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.355324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.355439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.355554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.355677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.355802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.355917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.356032 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.356147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.356261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.356383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.356508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.356632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.356749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.356863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.356978 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.357101 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.357225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.357344 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.357467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.357583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.357697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.357813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.358468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.358591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.358719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.358836 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.358952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.359066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.359180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.359295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.359418 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.359535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.359535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.359749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.359749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.359964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.359964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.360188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.360302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.360417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.360531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.360645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.360768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.360883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.360998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.361113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.361227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 15:08:03.361342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.361342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.361342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 15:08:03.361342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 15:08:03.388620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.388855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.389098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.389216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.389457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.389689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.397364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.397989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.425987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.426242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.426662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.426899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.480200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.480546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.528403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.528635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.529429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.529653 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.685916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.686196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.686196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.686407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.686507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.686586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.686661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.686728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.686848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.686941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.687067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.687149 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.710380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.710617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.710768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.710866 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.711008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.711091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.711240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.711323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.711471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.711554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.711686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.711768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.711907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.712128 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.723192 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.723606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.736067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.736243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.736348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.736467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.736549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.736689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.736771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.736907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.736998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.737122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.737203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.737337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81449) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.737418 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.737555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81450) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 15:08:03.753953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.754143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.754228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 15:08:03.754359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 15:08:03.754533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.754707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.754789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 15:08:03.754910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 15:08:03.755033 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.755191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.755282 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.755459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.755744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.755967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.756046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.756232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.765823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.766129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.766212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.766405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.766487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.766682 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.766772 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.766973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.773599 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.773936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.776518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.776804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.776883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.777093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.777175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.777380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.777472 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.777665 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.777745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.777927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.778019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.778221 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.778301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.778493 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.778571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.778768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.778879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.779157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.779235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.779430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.779510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.779750 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.802429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.802846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.803884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.804175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.804324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.804613 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.808831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.809115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.809305 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.809386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.809594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.809884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.816272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.816561 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.816816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.817108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.820639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.820936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.821225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.821304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.821514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.821606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.821796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.821876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.822102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.822183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.822375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.822457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.822642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.822721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.822933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.823189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.840113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.840393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.840713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.840997 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.844287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.844928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.847538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.847839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.848182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.848488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.852045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.852722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.855459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.856168 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.858740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.859043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.859328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.859490 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.859612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.859798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.859887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.860092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.860173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.860381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.860662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.860945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.876605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.876902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.877173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.877339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.877443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.877642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.877911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.878201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.884292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.885097 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.885818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.886121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.886668 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.886949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.888731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.889016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.889844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.890164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.890250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.890448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.890529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.890732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.891037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.891320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.901679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.901964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.902276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.902561 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.902846 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.902998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.903127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.903285 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.903408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.903572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.903857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.904150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.904432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.904736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.918771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.920184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.921931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.923293 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.924842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.926226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.926315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.927668 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.927763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.928031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.928327 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.929147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.929438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.929733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.934833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.936787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.936878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.938275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.939707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.940008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.940298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.940577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.941158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.941462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.941756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.942061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.948500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.948794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.949079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.949992 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.950312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.950601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.956609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81449) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.956880 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.957163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.957443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.957718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.958004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.958106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81450) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 15:08:03.958306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.958388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.958575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.958660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.958856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.958936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.959125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.959215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.959413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.959494 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.959691 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.959770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.959966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.960048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.960227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81449) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.960315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.960509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.960802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.961081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.961360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.961624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81450) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 15:08:03.994291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b755b9c9c0 pid: 81449 (default app) Aug 19 15:08:03.995710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b755b9c9c0 pid: 81450 (default app) Aug 19 15:08:03.997600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5c4d-18d0-4aca-828c-13786951be56 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:03.997890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5c4d-18d0-4aca-828c-13786951be56 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:03.998193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5c4d-18d0-4aca-828c-13786951be56 None None] PATH_INFO: `/v3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:04.002872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Fri Aug 19 15:08:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:10.542432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08eb49-9d16-4c75-9d95-132e44127571 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:10.542946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08eb49-9d16-4c75-9d95-132e44127571 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:10.543028 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08eb49-9d16-4c75-9d95-132e44127571 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:10.547307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:08:10.552604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c6acc-2382-4cfd-8c6f-a1dd3aa054fe None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:10.552988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c6acc-2382-4cfd-8c6f-a1dd3aa054fe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:10.553159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c6acc-2382-4cfd-8c6f-a1dd3aa054fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:10.624018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: INFO dbcounter [None req-735c6acc-2382-4cfd-8c6f-a1dd3aa054fe None None] Registered counter for database keystone Aug 19 15:08:10.642613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG oslo_db.sqlalchemy.engines [None req-735c6acc-2382-4cfd-8c6f-a1dd3aa054fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:08:10.648763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writer thread running {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:08:10.827555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG passlib.handlers.bcrypt [None req-735c6acc-2382-4cfd-8c6f-a1dd3aa054fe None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81449) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 15:08:10.827902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG passlib.handlers.bcrypt [None req-735c6acc-2382-4cfd-8c6f-a1dd3aa054fe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81449) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 15:08:10.882239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-735c6acc-2382-4cfd-8c6f-a1dd3aa054fe None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:10.883827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-735c6acc-2382-4cfd-8c6f-a1dd3aa054fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:11.009695 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 15:08:11.413770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08eb49-9d16-4c75-9d95-132e44127571 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:11.481885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: INFO dbcounter [None req-6b08eb49-9d16-4c75-9d95-132e44127571 None None] Registered counter for database keystone Aug 19 15:08:11.503428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG oslo_db.sqlalchemy.engines [None req-6b08eb49-9d16-4c75-9d95-132e44127571 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 15:08:11.509489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writer thread running {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 15:08:11.631832 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08eb49-9d16-4c75-9d95-132e44127571 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:11.636098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae738df-40b7-4a9c-a1be-f037e338a62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:11.636728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae738df-40b7-4a9c-a1be-f037e338a62e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:11.637009 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae738df-40b7-4a9c-a1be-f037e338a62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:11.637281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae738df-40b7-4a9c-a1be-f037e338a62e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:11.645846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae738df-40b7-4a9c-a1be-f037e338a62e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:11.696478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7ae738df-40b7-4a9c-a1be-f037e338a62e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 15:08:11.696762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae738df-40b7-4a9c-a1be-f037e338a62e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:11.706077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Aug 19 15:08:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 15:08:11.712577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c6acc-2382-4cfd-8c6f-a1dd3aa054fe None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:11.726759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c6acc-2382-4cfd-8c6f-a1dd3aa054fe None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:11.731438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18ee7f-1ad0-404e-a356-c8761822d832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:11.732529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18ee7f-1ad0-404e-a356-c8761822d832 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:11.733315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18ee7f-1ad0-404e-a356-c8761822d832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:11.733594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18ee7f-1ad0-404e-a356-c8761822d832 admin admin] PATH_INFO: `/v3/projects/b0c58200470045b79a04ba5897774f1b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:11.735185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18ee7f-1ad0-404e-a356-c8761822d832 admin admin] RBAC: Authorizing `identity:get_project(project_id=b0c58200470045b79a04ba5897774f1b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:11.787462 dv-cinder-835384-20-smb devstack@keystone.service[81449]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fb18ee7f-1ad0-404e-a356-c8761822d832 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 15:08:11.787806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18ee7f-1ad0-404e-a356-c8761822d832 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:11.792233 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Fri Aug 19 15:08:11 2022] GET /identity/v3/projects/b0c58200470045b79a04ba5897774f1b => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:13.649254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe051-bdfc-4ac0-ab9b-d0d9326d125a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:13.649721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe051-bdfc-4ac0-ab9b-d0d9326d125a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:13.649806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe051-bdfc-4ac0-ab9b-d0d9326d125a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:13.653961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:13.659308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db95c0-2919-4271-b30c-fa8c2bfdfedc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:13.659724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db95c0-2919-4271-b30c-fa8c2bfdfedc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:13.659859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db95c0-2919-4271-b30c-fa8c2bfdfedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:13.679139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d8db95c0-2919-4271-b30c-fa8c2bfdfedc None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:13.680633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d8db95c0-2919-4271-b30c-fa8c2bfdfedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:13.688838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 19 15:08:13.955217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfe051-bdfc-4ac0-ab9b-d0d9326d125a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:13.967817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfe051-bdfc-4ac0-ab9b-d0d9326d125a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:13.972088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0de6f-4d82-43de-bba8-9556b5455db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:13.972687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0de6f-4d82-43de-bba8-9556b5455db8 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:13.972971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0de6f-4d82-43de-bba8-9556b5455db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:13.973249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0de6f-4d82-43de-bba8-9556b5455db8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:13.981064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0de6f-4d82-43de-bba8-9556b5455db8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:13.982905 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0de6f-4d82-43de-bba8-9556b5455db8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:13.991590 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Aug 19 15:08:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:08:13.996692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db95c0-2919-4271-b30c-fa8c2bfdfedc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:14.005865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db95c0-2919-4271-b30c-fa8c2bfdfedc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:14.010173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c733-4e6a-4cc2-9bfa-d357d81e51b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:14.010788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c733-4e6a-4cc2-9bfa-d357d81e51b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:14.011064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c733-4e6a-4cc2-9bfa-d357d81e51b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:14.011334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c733-4e6a-4cc2-9bfa-d357d81e51b2 admin admin] PATH_INFO: `/v3/users/9828bdee3ea64cec99e58fcb117e4cdd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:14.012635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50c733-4e6a-4cc2-9bfa-d357d81e51b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=9828bdee3ea64cec99e58fcb117e4cdd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:14.015007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50c733-4e6a-4cc2-9bfa-d357d81e51b2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:14.016504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Fri Aug 19 15:08:13 2022] GET /identity/v3/users/9828bdee3ea64cec99e58fcb117e4cdd => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:15.966243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995bed8-4f86-4e5f-824d-c0f5638c06fa None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:15.966772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995bed8-4f86-4e5f-824d-c0f5638c06fa None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:15.966772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995bed8-4f86-4e5f-824d-c0f5638c06fa None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:15.968572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:15.973691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b74290-baed-4d3d-92f7-d8b533d49f8d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:15.974158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b74290-baed-4d3d-92f7-d8b533d49f8d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:15.974281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b74290-baed-4d3d-92f7-d8b533d49f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:15.992802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-67b74290-baed-4d3d-92f7-d8b533d49f8d None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:15.993991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-67b74290-baed-4d3d-92f7-d8b533d49f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:16.023861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85179-6e72-4b2f-9e77-e55dbcb6092e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:16.024146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85179-6e72-4b2f-9e77-e55dbcb6092e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:16.024427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b85179-6e72-4b2f-9e77-e55dbcb6092e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:16.025732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:08:16.031141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5b19-2712-41f0-849e-802f71d9b3dd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:16.031427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5b19-2712-41f0-849e-802f71d9b3dd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:16.031706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f5b19-2712-41f0-849e-802f71d9b3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:16.073069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:16.073542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG passlib.handlers.bcrypt [None req-d08f5b19-2712-41f0-849e-802f71d9b3dd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81450) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 15:08:16.073963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG passlib.handlers.bcrypt [None req-d08f5b19-2712-41f0-849e-802f71d9b3dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81450) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 15:08:16.120216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d08f5b19-2712-41f0-849e-802f71d9b3dd None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:16.122105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d08f5b19-2712-41f0-849e-802f71d9b3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:16.218848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:16.341254 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b74290-baed-4d3d-92f7-d8b533d49f8d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:16.365462 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:16.447544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b74290-baed-4d3d-92f7-d8b533d49f8d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:16.481220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb1001-91c6-4aa6-b378-9175d0ece8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:16.481820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb1001-91c6-4aa6-b378-9175d0ece8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:16.482133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb1001-91c6-4aa6-b378-9175d0ece8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:16.482409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb1001-91c6-4aa6-b378-9175d0ece8d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:16.488576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f5b19-2712-41f0-849e-802f71d9b3dd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:16.493501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb1001-91c6-4aa6-b378-9175d0ece8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-10cb1001-91c6-4aa6-b378-9175d0ece8d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:16.502405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:16.503329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:16.504334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:08:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:16.509299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb1001-91c6-4aa6-b378-9175d0ece8d8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:16.593508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:16.594864 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f5b19-2712-41f0-849e-802f71d9b3dd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:16.597429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:16.612819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb1001-91c6-4aa6-b378-9175d0ece8d8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:16.633542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48391414-2131-4308-8380-8cadc5515cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:16.634431 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48391414-2131-4308-8380-8cadc5515cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:16.634715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48391414-2131-4308-8380-8cadc5515cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:16.634996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48391414-2131-4308-8380-8cadc5515cb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:16.646759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec1f6-8912-4add-8b61-a663da7dbc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:16.647358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec1f6-8912-4add-8b61-a663da7dbc85 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:16.647635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec1f6-8912-4add-8b61-a663da7dbc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:16.647904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec1f6-8912-4add-8b61-a663da7dbc85 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:16.648567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec1f6-8912-4add-8b61-a663da7dbc85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:16.648863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec1f6-8912-4add-8b61-a663da7dbc85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:16.650276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ec1f6-8912-4add-8b61-a663da7dbc85 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:16.661697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:16.667283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec1f6-8912-4add-8b61-a663da7dbc85 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:16.703008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48391414-2131-4308-8380-8cadc5515cb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:16.704526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48391414-2131-4308-8380-8cadc5515cb1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:16.763594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec1f6-8912-4add-8b61-a663da7dbc85 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:16.797951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79515c-2fdd-4802-8987-230be5471505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:16.798605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79515c-2fdd-4802-8987-230be5471505 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:16.798888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79515c-2fdd-4802-8987-230be5471505 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:16.799158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79515c-2fdd-4802-8987-230be5471505 None admin] PATH_INFO: `/v3/users/9828bdee3ea64cec99e58fcb117e4cdd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:16.799838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 15:08:16.800296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79515c-2fdd-4802-8987-230be5471505 None admin] RBAC: Authorizing `identity:get_user(user_id=9828bdee3ea64cec99e58fcb117e4cdd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:16.801758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79515c-2fdd-4802-8987-230be5471505 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:16.803319 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:16 2022] GET /identity/v3/users/9828bdee3ea64cec99e58fcb117e4cdd => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:16.805517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48391414-2131-4308-8380-8cadc5515cb1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:16.808341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:16.808544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79515c-2fdd-4802-8987-230be5471505 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:16.822988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:16.903309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48391414-2131-4308-8380-8cadc5515cb1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:16.907385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79515c-2fdd-4802-8987-230be5471505 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:16.937683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85295-3fb6-4e28-bee0-02a9506fd8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:16.938568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85295-3fb6-4e28-bee0-02a9506fd8ce None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:16.938854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85295-3fb6-4e28-bee0-02a9506fd8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:16.939133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf85295-3fb6-4e28-bee0-02a9506fd8ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:16.940551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7462882-6947-473c-ac01-4d9ae965c24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:16.941168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7462882-6947-473c-ac01-4d9ae965c24f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:16.941445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7462882-6947-473c-ac01-4d9ae965c24f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:16.941714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7462882-6947-473c-ac01-4d9ae965c24f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:16.942868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7462882-6947-473c-ac01-4d9ae965c24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:16.944292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7462882-6947-473c-ac01-4d9ae965c24f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:16.945816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:16.951408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7462882-6947-473c-ac01-4d9ae965c24f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:16.957712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf85295-3fb6-4e28-bee0-02a9506fd8ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:16.959219 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf85295-3fb6-4e28-bee0-02a9506fd8ce None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-daf85295-3fb6-4e28-bee0-02a9506fd8ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:08:16.976934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:16.983957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:08:16.984751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:08:16.984751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:08:16.984751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:16.984751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:08:16.984751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85295-3fb6-4e28-bee0-02a9506fd8ce None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:17.030593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:17.040756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:17.051489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7462882-6947-473c-ac01-4d9ae965c24f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:17.085280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8a112-624a-45e3-a443-8ceca4ae4310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:17.085713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf85295-3fb6-4e28-bee0-02a9506fd8ce None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:17.085888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a112-624a-45e3-a443-8ceca4ae4310 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:17.086203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a112-624a-45e3-a443-8ceca4ae4310 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:17.086477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8a112-624a-45e3-a443-8ceca4ae4310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:17.087200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a112-624a-45e3-a443-8ceca4ae4310 None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.domain.id=default, user.id=9828bdee3ea64cec99e58fcb117e4cdd) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:17.087503 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a112-624a-45e3-a443-8ceca4ae4310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:17.088928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8a112-624a-45e3-a443-8ceca4ae4310 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:17.095428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Aug 19 15:08:16 2022] GET /identity/v3/role_assignments?user.id=9828bdee3ea64cec99e58fcb117e4cdd&scope.domain.id=default&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:17.120978 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae971d-2ff8-44e0-ad90-5de33c18e8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:17.121614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae971d-2ff8-44e0-ad90-5de33c18e8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:17.121897 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae971d-2ff8-44e0-ad90-5de33c18e8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:17.122208 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae971d-2ff8-44e0-ad90-5de33c18e8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:17.122878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae971d-2ff8-44e0-ad90-5de33c18e8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:17.123748 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae971d-2ff8-44e0-ad90-5de33c18e8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:17.125184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae971d-2ff8-44e0-ad90-5de33c18e8f2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:17.144837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:19.351445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7861c4-0e9c-495c-8fcf-47b1ee144235 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:19.351960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7861c4-0e9c-495c-8fcf-47b1ee144235 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:19.352031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7861c4-0e9c-495c-8fcf-47b1ee144235 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:19.353449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:19.359024 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631db90-c3c3-4767-9d7b-e5f4a4ce6398 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:19.359410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631db90-c3c3-4767-9d7b-e5f4a4ce6398 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:19.359689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631db90-c3c3-4767-9d7b-e5f4a4ce6398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:19.384922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0631db90-c3c3-4767-9d7b-e5f4a4ce6398 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:19.386171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0631db90-c3c3-4767-9d7b-e5f4a4ce6398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:19.436658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7343e-42a3-484b-bd94-8173ac9c806a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:19.436975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7343e-42a3-484b-bd94-8173ac9c806a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:19.437222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7343e-42a3-484b-bd94-8173ac9c806a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:19.438606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 13/23] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:19.449628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb731e-d887-4552-bdd8-41099c527e64 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:19.449910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb731e-d887-4552-bdd8-41099c527e64 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:19.450215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb731e-d887-4552-bdd8-41099c527e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:19.480162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:19.491002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0dbb731e-d887-4552-bdd8-41099c527e64 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:19.492221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0dbb731e-d887-4552-bdd8-41099c527e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:19.603423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:19.666614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704de9a-8258-4d7c-8747-ce9896b1e386 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:19.666915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704de9a-8258-4d7c-8747-ce9896b1e386 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:19.667178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704de9a-8258-4d7c-8747-ce9896b1e386 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:19.668536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 12/26] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:19.679330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a471cd-e8bb-4570-bddc-0e014224607f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:19.679620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a471cd-e8bb-4570-bddc-0e014224607f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:19.679896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a471cd-e8bb-4570-bddc-0e014224607f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:19.685097 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810333-d78e-429a-99ec-cc82e17a0f9e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:19.685388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810333-d78e-429a-99ec-cc82e17a0f9e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:19.685714 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07810333-d78e-429a-99ec-cc82e17a0f9e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:19.687027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:08:19.694270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49003d1-a7b4-499e-b669-906b5685c1fa None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:19.694563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49003d1-a7b4-499e-b669-906b5685c1fa None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:19.694844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49003d1-a7b4-499e-b669-906b5685c1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:19.703339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-84a471cd-e8bb-4570-bddc-0e014224607f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:19.704539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-84a471cd-e8bb-4570-bddc-0e014224607f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:19.723005 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c49003d1-a7b4-499e-b669-906b5685c1fa None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:19.724210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c49003d1-a7b4-499e-b669-906b5685c1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:19.807910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:19.839582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 15/28] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:19.852491 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 14/29] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:19.936037 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a471cd-e8bb-4570-bddc-0e014224607f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:19.939643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:19.992657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49003d1-a7b4-499e-b669-906b5685c1fa None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:20.084144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a471cd-e8bb-4570-bddc-0e014224607f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:20.143616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585f1e-af57-4955-8414-2236cc834ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:20.144709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585f1e-af57-4955-8414-2236cc834ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:20.145206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585f1e-af57-4955-8414-2236cc834ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:20.145676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce585f1e-af57-4955-8414-2236cc834ca8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:20.167018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce585f1e-af57-4955-8414-2236cc834ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ce585f1e-af57-4955-8414-2236cc834ca8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:20.172953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:20.173779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:20.174555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:20.176913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 16/30] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:08:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:20.183256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585f1e-af57-4955-8414-2236cc834ca8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:20.256235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49003d1-a7b4-499e-b669-906b5685c1fa None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:20.302442 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:20.317421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c149-d96a-4250-9a08-20182b8634f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:20.318354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c149-d96a-4250-9a08-20182b8634f9 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:20.318836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c149-d96a-4250-9a08-20182b8634f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:20.319697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c149-d96a-4250-9a08-20182b8634f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:20.320565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c149-d96a-4250-9a08-20182b8634f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:20.322945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c149-d96a-4250-9a08-20182b8634f9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:20.349104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce585f1e-af57-4955-8414-2236cc834ca8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:20.393897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d885f-fd0e-444b-9d2b-a23553c91e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:20.395328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d885f-fd0e-444b-9d2b-a23553c91e75 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:20.395807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d885f-fd0e-444b-9d2b-a23553c91e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:20.396286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d885f-fd0e-444b-9d2b-a23553c91e75 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:20.397148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d885f-fd0e-444b-9d2b-a23553c91e75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:20.397663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d885f-fd0e-444b-9d2b-a23553c91e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:20.399306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d885f-fd0e-444b-9d2b-a23553c91e75 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:20.408221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 17/31] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:20.409403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d885f-fd0e-444b-9d2b-a23553c91e75 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:20.455300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 15/32] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 19 15:08:19 2022] POST /identity/v3/roles => generated 219 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:08:20.456159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c149-d96a-4250-9a08-20182b8634f9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:20.497895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:20.554216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d885f-fd0e-444b-9d2b-a23553c91e75 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:20.585040 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c149-d96a-4250-9a08-20182b8634f9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:20.591298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:20.603209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e399378-f17b-4d88-9aa4-b08369d8bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:20.604180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e399378-f17b-4d88-9aa4-b08369d8bf38 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:20.604610 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e399378-f17b-4d88-9aa4-b08369d8bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:20.605400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e399378-f17b-4d88-9aa4-b08369d8bf38 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:20.606382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e399378-f17b-4d88-9aa4-b08369d8bf38 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:20.608054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e399378-f17b-4d88-9aa4-b08369d8bf38 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:20.630405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e679457-0415-4234-935e-670ec5b64d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:20.631142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e679457-0415-4234-935e-670ec5b64d44 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:20.631535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e679457-0415-4234-935e-670ec5b64d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:20.631884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e679457-0415-4234-935e-670ec5b64d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:20.643628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e679457-0415-4234-935e-670ec5b64d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:20.645369 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e679457-0415-4234-935e-670ec5b64d44 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1e679457-0415-4234-935e-670ec5b64d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:08:20.662450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:20.663393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:08:20.664200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:08:20.664200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:08:20.664200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:20.664200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 16/33] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:20.664922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e679457-0415-4234-935e-670ec5b64d44 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:20.750184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 18/34] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 19 15:08:20 2022] POST /identity/v3/roles => generated 225 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:08:20.751457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e399378-f17b-4d88-9aa4-b08369d8bf38 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:20.760366 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:20.774228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e679457-0415-4234-935e-670ec5b64d44 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:20.812837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99061f-5bb9-46de-938f-c8bc7934706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:20.813520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99061f-5bb9-46de-938f-c8bc7934706d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:20.813834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99061f-5bb9-46de-938f-c8bc7934706d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:20.814203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a99061f-5bb9-46de-938f-c8bc7934706d None admin] PATH_INFO: `/v3/users/9828bdee3ea64cec99e58fcb117e4cdd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:20.815933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99061f-5bb9-46de-938f-c8bc7934706d None admin] RBAC: Authorizing `identity:get_user(user_id=9828bdee3ea64cec99e58fcb117e4cdd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:20.818200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a99061f-5bb9-46de-938f-c8bc7934706d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:20.819392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 17/35] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:20 2022] GET /identity/v3/users/9828bdee3ea64cec99e58fcb117e4cdd => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:20.826092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99061f-5bb9-46de-938f-c8bc7934706d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:20.899436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e399378-f17b-4d88-9aa4-b08369d8bf38 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:20.940208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c439aa-c93b-481c-b882-dbaea66a0988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:20.941135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c439aa-c93b-481c-b882-dbaea66a0988 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:20.941686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c439aa-c93b-481c-b882-dbaea66a0988 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:20.942166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c439aa-c93b-481c-b882-dbaea66a0988 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:20.943149 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c439aa-c93b-481c-b882-dbaea66a0988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:20.943736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c439aa-c93b-481c-b882-dbaea66a0988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:20.945477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c439aa-c93b-481c-b882-dbaea66a0988 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:20.966048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 19/36] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:20.972792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c439aa-c93b-481c-b882-dbaea66a0988 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:20.982164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a99061f-5bb9-46de-938f-c8bc7934706d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:21.021467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3716dac-6535-497d-ac66-fd7bf05f93b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:21.022163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3716dac-6535-497d-ac66-fd7bf05f93b5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:21.022449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3716dac-6535-497d-ac66-fd7bf05f93b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:21.022726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3716dac-6535-497d-ac66-fd7bf05f93b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:21.023959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3716dac-6535-497d-ac66-fd7bf05f93b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:21.025423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3716dac-6535-497d-ac66-fd7bf05f93b5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:21.032065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 18/37] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:21.033485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3716dac-6535-497d-ac66-fd7bf05f93b5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:21.066587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:21.151673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:21.153933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3716dac-6535-497d-ac66-fd7bf05f93b5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:21.191664 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890e703-d8ba-4fb3-b5a9-42dc1c856421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:21.192331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890e703-d8ba-4fb3-b5a9-42dc1c856421 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:21.192610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890e703-d8ba-4fb3-b5a9-42dc1c856421 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:21.192883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890e703-d8ba-4fb3-b5a9-42dc1c856421 None admin] PATH_INFO: `/v3/domains/default/users/9828bdee3ea64cec99e58fcb117e4cdd/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:21.194855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890e703-d8ba-4fb3-b5a9-42dc1c856421 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9828bdee3ea64cec99e58fcb117e4cdd, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:21.196321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890e703-d8ba-4fb3-b5a9-42dc1c856421 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:21.211515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 19/38] 10.222.0.20 () {58 vars in 1361 bytes} [Fri Aug 19 15:08:21 2022] PUT /identity/v3/domains/default/users/9828bdee3ea64cec99e58fcb117e4cdd/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:08:21.212813 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555567a0-a3db-4844-9391-91da07322ec3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:21.213098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555567a0-a3db-4844-9391-91da07322ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:21.213374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555567a0-a3db-4844-9391-91da07322ec3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:21.214802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 20/39] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:21.220786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14877bf8-ecbe-4d5f-9351-8b1afeb8d61e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:21.221069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14877bf8-ecbe-4d5f-9351-8b1afeb8d61e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:21.221353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14877bf8-ecbe-4d5f-9351-8b1afeb8d61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:21.224402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c439aa-c93b-481c-b882-dbaea66a0988 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:21.242057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-14877bf8-ecbe-4d5f-9351-8b1afeb8d61e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:21.243677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-14877bf8-ecbe-4d5f-9351-8b1afeb8d61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:21.267040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe70c8-b2ba-4451-bdc7-6ae05cec8090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:21.268057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe70c8-b2ba-4451-bdc7-6ae05cec8090 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:21.268593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe70c8-b2ba-4451-bdc7-6ae05cec8090 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:21.269208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe70c8-b2ba-4451-bdc7-6ae05cec8090 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:21.270251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe70c8-b2ba-4451-bdc7-6ae05cec8090 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:21.271964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe70c8-b2ba-4451-bdc7-6ae05cec8090 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:21.318409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 20/40] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:08:20 2022] POST /identity/v3/projects => generated 301 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:08:21.318958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 21/41] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:21.320002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574808f-0c57-4343-94c4-c3c967526111 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:21.320315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574808f-0c57-4343-94c4-c3c967526111 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:21.320602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574808f-0c57-4343-94c4-c3c967526111 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:21.326617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 21/42] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:21.328527 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309bba0-a619-402e-8429-51a31a1333ab None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:21.328823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309bba0-a619-402e-8429-51a31a1333ab None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:21.329105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309bba0-a619-402e-8429-51a31a1333ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:21.352109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5309bba0-a619-402e-8429-51a31a1333ab None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:21.353334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5309bba0-a619-402e-8429-51a31a1333ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:21.367135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:21.443108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 22/43] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:21.607782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574808f-0c57-4343-94c4-c3c967526111 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:21.706749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:21.712407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574808f-0c57-4343-94c4-c3c967526111 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:21.719774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309bba0-a619-402e-8429-51a31a1333ab None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:21.752979 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805baa5-0015-4183-aa46-10a285a27394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:21.753623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805baa5-0015-4183-aa46-10a285a27394 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:21.753906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805baa5-0015-4183-aa46-10a285a27394 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:21.754211 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805baa5-0015-4183-aa46-10a285a27394 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:21.755331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805baa5-0015-4183-aa46-10a285a27394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:21.756804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805baa5-0015-4183-aa46-10a285a27394 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:21.758569 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 22/44] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:21.764330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805baa5-0015-4183-aa46-10a285a27394 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:21.832109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309bba0-a619-402e-8429-51a31a1333ab None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:21.864905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805baa5-0015-4183-aa46-10a285a27394 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:21.868637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33c82d-a7ed-4324-b540-dd54920846dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:21.869307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33c82d-a7ed-4324-b540-dd54920846dd None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:21.869597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33c82d-a7ed-4324-b540-dd54920846dd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:21.869877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33c82d-a7ed-4324-b540-dd54920846dd None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:21.870633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33c82d-a7ed-4324-b540-dd54920846dd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:21.872232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33c82d-a7ed-4324-b540-dd54920846dd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:21.888466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 19 15:08:21 2022] POST /identity/v3/roles => generated 223 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:08:21.909113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2638678-2550-4686-ae0f-a49e224adba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:21.909752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2638678-2550-4686-ae0f-a49e224adba7 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:21.910063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2638678-2550-4686-ae0f-a49e224adba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:21.910344 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2638678-2550-4686-ae0f-a49e224adba7 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:21.911016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2638678-2550-4686-ae0f-a49e224adba7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:21.912544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2638678-2550-4686-ae0f-a49e224adba7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:21.944587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:08:21 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:08:23.162853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181132f-f248-4815-8b97-c797309e9de8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:23.163364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181132f-f248-4815-8b97-c797309e9de8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:23.163445 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181132f-f248-4815-8b97-c797309e9de8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:23.164736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:23.170560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f47a-e247-42cf-84ce-91bf13daa576 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:23.170982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f47a-e247-42cf-84ce-91bf13daa576 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:23.171114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f47a-e247-42cf-84ce-91bf13daa576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:23.189393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8615f47a-e247-42cf-84ce-91bf13daa576 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:23.190964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8615f47a-e247-42cf-84ce-91bf13daa576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:23.203712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:23.256754 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:23.532717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181132f-f248-4815-8b97-c797309e9de8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:23.536587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:23.634709 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181132f-f248-4815-8b97-c797309e9de8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:23.667422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28305667-1666-46a4-b368-b5ee5cc25226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:23.668052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28305667-1666-46a4-b368-b5ee5cc25226 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:23.668333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28305667-1666-46a4-b368-b5ee5cc25226 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:23.668606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28305667-1666-46a4-b368-b5ee5cc25226 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:23.679988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28305667-1666-46a4-b368-b5ee5cc25226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-28305667-1666-46a4-b368-b5ee5cc25226 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:23.686276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:23.687100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:23.687918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 25/49] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:08:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:23.693208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f47a-e247-42cf-84ce-91bf13daa576 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:23.789830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f47a-e247-42cf-84ce-91bf13daa576 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:23.821975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5729e-5888-4798-ae7a-d6f2a6324972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:23.822614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5729e-5888-4798-ae7a-d6f2a6324972 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:23.822895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5729e-5888-4798-ae7a-d6f2a6324972 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:23.823168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5729e-5888-4798-ae7a-d6f2a6324972 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:23.823833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5729e-5888-4798-ae7a-d6f2a6324972 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:23.824205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5729e-5888-4798-ae7a-d6f2a6324972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:23.825508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5729e-5888-4798-ae7a-d6f2a6324972 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:23.833928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 25/50] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:23.839426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28305667-1666-46a4-b368-b5ee5cc25226 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:23.859005 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90119a8-fb1c-407c-a869-b3496c4cebc0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:23.859292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90119a8-fb1c-407c-a869-b3496c4cebc0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:23.859570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90119a8-fb1c-407c-a869-b3496c4cebc0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:23.860893 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 26/51] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:08:23.865594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f81e-1ebc-456d-bdf1-408b6837a31b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:23.865887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f81e-1ebc-456d-bdf1-408b6837a31b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:23.866205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f81e-1ebc-456d-bdf1-408b6837a31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:23.883389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a159f81e-1ebc-456d-bdf1-408b6837a31b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:23.884572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a159f81e-1ebc-456d-bdf1-408b6837a31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:23.887317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:23.903805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:23.953286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 27/52] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:24.046330 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28305667-1666-46a4-b368-b5ee5cc25226 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:24.079561 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba44f92-b0a3-4d38-8a3e-67bc10b36e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:24.080181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba44f92-b0a3-4d38-8a3e-67bc10b36e64 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:24.080462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba44f92-b0a3-4d38-8a3e-67bc10b36e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:24.080738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba44f92-b0a3-4d38-8a3e-67bc10b36e64 None admin] PATH_INFO: `/v3/users/9828bdee3ea64cec99e58fcb117e4cdd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:24.081860 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba44f92-b0a3-4d38-8a3e-67bc10b36e64 None admin] RBAC: Authorizing `identity:get_user(user_id=9828bdee3ea64cec99e58fcb117e4cdd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:24.083325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba44f92-b0a3-4d38-8a3e-67bc10b36e64 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:24.084889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:23 2022] GET /identity/v3/users/9828bdee3ea64cec99e58fcb117e4cdd => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:24.090454 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f81e-1ebc-456d-bdf1-408b6837a31b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:24.185177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f81e-1ebc-456d-bdf1-408b6837a31b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:24.217415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba44f92-b0a3-4d38-8a3e-67bc10b36e64 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:24.218567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aac562-9c92-4e17-863b-00b1db32ad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:24.219207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aac562-9c92-4e17-863b-00b1db32ad41 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:24.219487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aac562-9c92-4e17-863b-00b1db32ad41 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:24.219759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aac562-9c92-4e17-863b-00b1db32ad41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:24.221625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aac562-9c92-4e17-863b-00b1db32ad41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:24.222379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aac562-9c92-4e17-863b-00b1db32ad41 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:24.223948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 28/54] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:24.229472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aac562-9c92-4e17-863b-00b1db32ad41 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:24.240567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:24.315545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba44f92-b0a3-4d38-8a3e-67bc10b36e64 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:24.329300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aac562-9c92-4e17-863b-00b1db32ad41 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:24.344529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:24.349765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86af79-0f1b-4a98-b032-0aa5e3af454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:24.350423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86af79-0f1b-4a98-b032-0aa5e3af454c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:24.350709 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86af79-0f1b-4a98-b032-0aa5e3af454c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:24.350986 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86af79-0f1b-4a98-b032-0aa5e3af454c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:24.352088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86af79-0f1b-4a98-b032-0aa5e3af454c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:24.353521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86af79-0f1b-4a98-b032-0aa5e3af454c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:24.355376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:24.361355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86af79-0f1b-4a98-b032-0aa5e3af454c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:24.363661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14332dc4-9378-4841-9788-9e3ea489eb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:24.364265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332dc4-9378-4841-9788-9e3ea489eb42 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:24.364546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332dc4-9378-4841-9788-9e3ea489eb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:24.364823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332dc4-9378-4841-9788-9e3ea489eb42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:24.365545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14332dc4-9378-4841-9788-9e3ea489eb42 None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.domain.id=default, user.id=9828bdee3ea64cec99e58fcb117e4cdd) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:24.365851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14332dc4-9378-4841-9788-9e3ea489eb42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:24.367320 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14332dc4-9378-4841-9788-9e3ea489eb42 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:24.372963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 29/56] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Aug 19 15:08:24 2022] GET /identity/v3/role_assignments?user.id=9828bdee3ea64cec99e58fcb117e4cdd&scope.domain.id=default&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:24.464430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86af79-0f1b-4a98-b032-0aa5e3af454c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:24.500106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1b147-7ff4-4699-beaa-ce0fcb711d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:24.500731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1b147-7ff4-4699-beaa-ce0fcb711d46 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:24.501014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1b147-7ff4-4699-beaa-ce0fcb711d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:24.501293 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1b147-7ff4-4699-beaa-ce0fcb711d46 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:24.501946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1b147-7ff4-4699-beaa-ce0fcb711d46 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:24.503417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1b147-7ff4-4699-beaa-ce0fcb711d46 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:24.535652 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 28/57] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Aug 19 15:08:24 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:08:26.434659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770dac-631d-4b15-9a85-8513aeb92d28 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:26.435220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770dac-631d-4b15-9a85-8513aeb92d28 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:26.435220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770dac-631d-4b15-9a85-8513aeb92d28 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:26.436583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 30/58] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:26.441733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03132-3351-417f-8ca3-8cc644911ef9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:26.442170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03132-3351-417f-8ca3-8cc644911ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:26.442321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae03132-3351-417f-8ca3-8cc644911ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:26.459846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cae03132-3351-417f-8ca3-8cc644911ef9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:26.461046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cae03132-3351-417f-8ca3-8cc644911ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:26.507896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:26.527896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 29/59] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:26.801436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3770dac-631d-4b15-9a85-8513aeb92d28 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:26.870579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:26.901247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3770dac-631d-4b15-9a85-8513aeb92d28 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:26.933718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842bbd8-90b6-468d-8a6a-054f78df0194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:26.934361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842bbd8-90b6-468d-8a6a-054f78df0194 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:26.934643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842bbd8-90b6-468d-8a6a-054f78df0194 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:26.934914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842bbd8-90b6-468d-8a6a-054f78df0194 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:26.936490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842bbd8-90b6-468d-8a6a-054f78df0194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:26.937930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842bbd8-90b6-468d-8a6a-054f78df0194 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:26.939481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 31/60] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:26.944921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae03132-3351-417f-8ca3-8cc644911ef9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:27.038758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae03132-3351-417f-8ca3-8cc644911ef9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:27.072633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30942f2-0ef0-4e9b-a911-5d3d8b685c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:27.073166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30942f2-0ef0-4e9b-a911-5d3d8b685c66 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:27.073447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30942f2-0ef0-4e9b-a911-5d3d8b685c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:27.073719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30942f2-0ef0-4e9b-a911-5d3d8b685c66 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:27.074392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30942f2-0ef0-4e9b-a911-5d3d8b685c66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:27.075893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30942f2-0ef0-4e9b-a911-5d3d8b685c66 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:27.102884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 30/61] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:08:26 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:08:30.030643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294f740-4df8-40d4-89b3-5f03fa095a83 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.031672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294f740-4df8-40d4-89b3-5f03fa095a83 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.032155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294f740-4df8-40d4-89b3-5f03fa095a83 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.033684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 32/62] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:30.039159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403996b5-0e00-4cbd-bb5d-a9c621dc170a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.039565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403996b5-0e00-4cbd-bb5d-a9c621dc170a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.039729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403996b5-0e00-4cbd-bb5d-a9c621dc170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.067178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-403996b5-0e00-4cbd-bb5d-a9c621dc170a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:30.068395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-403996b5-0e00-4cbd-bb5d-a9c621dc170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:30.096034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe131-c5cd-4a0c-8705-9ab2d7cf5b75 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.096623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe131-c5cd-4a0c-8705-9ab2d7cf5b75 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.097079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe131-c5cd-4a0c-8705-9ab2d7cf5b75 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.103060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 33/63] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:30.106635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:30.109878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f7aef-91ab-41a9-9e3d-df3896a6147c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.110553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f7aef-91ab-41a9-9e3d-df3896a6147c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.111061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f7aef-91ab-41a9-9e3d-df3896a6147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.135588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-714f7aef-91ab-41a9-9e3d-df3896a6147c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:30.136811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-714f7aef-91ab-41a9-9e3d-df3896a6147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:30.164195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 31/64] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:30.251921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 34/65] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:30.313035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d648f0-fa83-4a54-b19f-5e03cbe98b1f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.313641 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d648f0-fa83-4a54-b19f-5e03cbe98b1f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.314150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d648f0-fa83-4a54-b19f-5e03cbe98b1f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.315706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 32/66] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:30.320968 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332746e9-a4a5-4c28-9d11-377673ce0e68 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.321258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332746e9-a4a5-4c28-9d11-377673ce0e68 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.321536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332746e9-a4a5-4c28-9d11-377673ce0e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.347469 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-332746e9-a4a5-4c28-9d11-377673ce0e68 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:30.348648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-332746e9-a4a5-4c28-9d11-377673ce0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:30.433009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:30.437774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 35/67] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:30.602734 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d648f0-fa83-4a54-b19f-5e03cbe98b1f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:30.662669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332746e9-a4a5-4c28-9d11-377673ce0e68 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:30.755628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d648f0-fa83-4a54-b19f-5e03cbe98b1f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:30.792086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332746e9-a4a5-4c28-9d11-377673ce0e68 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:30.792270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fa6c1-9e5b-4d6a-bd16-90bb968c3fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:30.792925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fa6c1-9e5b-4d6a-bd16-90bb968c3fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.793210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fa6c1-9e5b-4d6a-bd16-90bb968c3fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.793484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fa6c1-9e5b-4d6a-bd16-90bb968c3fc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.804324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fa6c1-9e5b-4d6a-bd16-90bb968c3fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-281fa6c1-9e5b-4d6a-bd16-90bb968c3fc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:30.809702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:30.811197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:30.811952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 33/68] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:08:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:30.813056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642da4f-a521-4697-b6e4-81075b2e75d6 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.813344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642da4f-a521-4697-b6e4-81075b2e75d6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.813620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642da4f-a521-4697-b6e4-81075b2e75d6 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.815091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 34/69] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:30.819191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642da4f-a521-4697-b6e4-81075b2e75d6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:30.832769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975ee47-37f6-43fd-af07-b5c6ce1beb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:30.833564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975ee47-37f6-43fd-af07-b5c6ce1beb28 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.833846 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975ee47-37f6-43fd-af07-b5c6ce1beb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.834155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975ee47-37f6-43fd-af07-b5c6ce1beb28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.845266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975ee47-37f6-43fd-af07-b5c6ce1beb28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:30.849120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1975ee47-37f6-43fd-af07-b5c6ce1beb28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:30.850083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:30.850881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:30.851619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 36/70] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:08:30.852249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975ee47-37f6-43fd-af07-b5c6ce1beb28 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:30.918744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:30.935016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642da4f-a521-4697-b6e4-81075b2e75d6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:30.959132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975ee47-37f6-43fd-af07-b5c6ce1beb28 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:30.968019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f3dba-fc8b-40e2-87b7-db837585ca2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:30.968646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f3dba-fc8b-40e2-87b7-db837585ca2b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.968925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f3dba-fc8b-40e2-87b7-db837585ca2b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.969198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f3dba-fc8b-40e2-87b7-db837585ca2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.978846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f3dba-fc8b-40e2-87b7-db837585ca2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-045f3dba-fc8b-40e2-87b7-db837585ca2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:30.983818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:30.984665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:30.985660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:08:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:30.990703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475343a-3b6d-4ec3-b0a9-bda2226fc70e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.990992 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475343a-3b6d-4ec3-b0a9-bda2226fc70e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.991267 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475343a-3b6d-4ec3-b0a9-bda2226fc70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.992298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80745068-4593-43af-8eb4-66ad58ca3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:30.992907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745068-4593-43af-8eb4-66ad58ca3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:30.993190 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745068-4593-43af-8eb4-66ad58ca3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:30.993464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745068-4593-43af-8eb4-66ad58ca3dd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:30.994167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80745068-4593-43af-8eb4-66ad58ca3dd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:30.994478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80745068-4593-43af-8eb4-66ad58ca3dd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:30.995848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80745068-4593-43af-8eb4-66ad58ca3dd2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:31.004225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 37/72] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:08:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:31.005008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80745068-4593-43af-8eb4-66ad58ca3dd2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:31.008524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5475343a-3b6d-4ec3-b0a9-bda2226fc70e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:31.009710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5475343a-3b6d-4ec3-b0a9-bda2226fc70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:31.075273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 36/73] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:31.077173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b1c0-c00c-4b4c-a051-a7a34f2eeb21 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:31.077468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b1c0-c00c-4b4c-a051-a7a34f2eeb21 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:31.077745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1b1c0-c00c-4b4c-a051-a7a34f2eeb21 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:31.079047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 37/74] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:31.083837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b1c0-c00c-4b4c-a051-a7a34f2eeb21 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:31.103958 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80745068-4593-43af-8eb4-66ad58ca3dd2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:31.107823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:31.128151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:31.141953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905622b8-9f1d-4b15-9254-bc0ed426153c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:31.142915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905622b8-9f1d-4b15-9254-bc0ed426153c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:31.143202 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905622b8-9f1d-4b15-9254-bc0ed426153c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:31.143481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905622b8-9f1d-4b15-9254-bc0ed426153c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:31.144150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905622b8-9f1d-4b15-9254-bc0ed426153c None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:31.144461 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905622b8-9f1d-4b15-9254-bc0ed426153c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:31.146355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905622b8-9f1d-4b15-9254-bc0ed426153c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:31.154562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:31.158327 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905622b8-9f1d-4b15-9254-bc0ed426153c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:31.199563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1b1c0-c00c-4b4c-a051-a7a34f2eeb21 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:31.236034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e94189-4b53-46d1-9cf9-4ead09f40bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:31.236634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e94189-4b53-46d1-9cf9-4ead09f40bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:31.237160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e94189-4b53-46d1-9cf9-4ead09f40bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:31.237160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e94189-4b53-46d1-9cf9-4ead09f40bf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:31.237851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e94189-4b53-46d1-9cf9-4ead09f40bf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:31.238189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e94189-4b53-46d1-9cf9-4ead09f40bf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:31.239602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e94189-4b53-46d1-9cf9-4ead09f40bf9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:31.255565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 38/76] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:31.255565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7efde6-0d87-422a-8017-4af9bf5137ab None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:31.255565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7efde6-0d87-422a-8017-4af9bf5137ab None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:31.255565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7efde6-0d87-422a-8017-4af9bf5137ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:31.268395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905622b8-9f1d-4b15-9254-bc0ed426153c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:31.272271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2b7efde6-0d87-422a-8017-4af9bf5137ab None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:31.273482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2b7efde6-0d87-422a-8017-4af9bf5137ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:31.305028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8aed1-4c8a-4e88-bbcb-901ba2ba04ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:31.305850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8aed1-4c8a-4e88-bbcb-901ba2ba04ae None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:31.306162 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8aed1-4c8a-4e88-bbcb-901ba2ba04ae None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:31.306444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8aed1-4c8a-4e88-bbcb-901ba2ba04ae None admin] PATH_INFO: `/v3/users/8556ff7ce3fc415290dc56e1f7145ebd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:31.320283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8aed1-4c8a-4e88-bbcb-901ba2ba04ae None admin] RBAC: Authorizing `identity:get_user(user_id=8556ff7ce3fc415290dc56e1f7145ebd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:31.321730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8aed1-4c8a-4e88-bbcb-901ba2ba04ae None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:31.323494 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 39/77] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:31 2022] GET /identity/v3/users/8556ff7ce3fc415290dc56e1f7145ebd => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:31.328670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8aed1-4c8a-4e88-bbcb-901ba2ba04ae None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:31.358072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 39/78] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:31.358072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7efde6-0d87-422a-8017-4af9bf5137ab None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:31.360046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:31.370640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:31.435199 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8aed1-4c8a-4e88-bbcb-901ba2ba04ae None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:31.451906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7efde6-0d87-422a-8017-4af9bf5137ab None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:31.474681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e052c-18e6-4a34-bfa5-2bb9ffe367c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:31.475312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e052c-18e6-4a34-bfa5-2bb9ffe367c7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:31.475597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e052c-18e6-4a34-bfa5-2bb9ffe367c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:31.476038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e052c-18e6-4a34-bfa5-2bb9ffe367c7 None admin] PATH_INFO: `/v3/users/8556ff7ce3fc415290dc56e1f7145ebd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:31.477014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e052c-18e6-4a34-bfa5-2bb9ffe367c7 None admin] RBAC: Authorizing `identity:get_user(user_id=8556ff7ce3fc415290dc56e1f7145ebd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:31.478485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e052c-18e6-4a34-bfa5-2bb9ffe367c7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:31.480503 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:31 2022] GET /identity/v3/users/8556ff7ce3fc415290dc56e1f7145ebd => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:31.481322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e052c-18e6-4a34-bfa5-2bb9ffe367c7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:31.493675 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a923070-f80e-4d90-b0ba-eb6e1fbe5671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:31.494339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a923070-f80e-4d90-b0ba-eb6e1fbe5671 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:31.494614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a923070-f80e-4d90-b0ba-eb6e1fbe5671 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:31.494887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a923070-f80e-4d90-b0ba-eb6e1fbe5671 None admin] PATH_INFO: `/v3/users/9828bdee3ea64cec99e58fcb117e4cdd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:31.496018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a923070-f80e-4d90-b0ba-eb6e1fbe5671 None admin] RBAC: Authorizing `identity:get_user(user_id=9828bdee3ea64cec99e58fcb117e4cdd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:31.497588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a923070-f80e-4d90-b0ba-eb6e1fbe5671 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:31.499494 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 40/80] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:31 2022] GET /identity/v3/users/9828bdee3ea64cec99e58fcb117e4cdd => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:31.500425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a923070-f80e-4d90-b0ba-eb6e1fbe5671 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:31.589550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e052c-18e6-4a34-bfa5-2bb9ffe367c7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:31.591146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:31.601302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:31.616101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a923070-f80e-4d90-b0ba-eb6e1fbe5671 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:31.626623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51f456-aafa-4d8a-b58b-93b46c3845bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:31.627230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51f456-aafa-4d8a-b58b-93b46c3845bc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:31.627510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51f456-aafa-4d8a-b58b-93b46c3845bc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:31.627788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51f456-aafa-4d8a-b58b-93b46c3845bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:31.653608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0fece-36ad-4c78-97ea-3a3b631c8c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:31.654393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0fece-36ad-4c78-97ea-3a3b631c8c6d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:31.654600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0fece-36ad-4c78-97ea-3a3b631c8c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:31.654876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0fece-36ad-4c78-97ea-3a3b631c8c6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:31.664792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0fece-36ad-4c78-97ea-3a3b631c8c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-26a0fece-36ad-4c78-97ea-3a3b631c8c6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:31.669515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:31.670395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 41/81] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:31.672225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0fece-36ad-4c78-97ea-3a3b631c8c6d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:31.695835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51f456-aafa-4d8a-b58b-93b46c3845bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:31.697296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51f456-aafa-4d8a-b58b-93b46c3845bc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:31.772150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0fece-36ad-4c78-97ea-3a3b631c8c6d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:31.795059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 41/82] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:31.795988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51f456-aafa-4d8a-b58b-93b46c3845bc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:31.805189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db859b50-3ae2-445a-9e19-e7912529ebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:31.805796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859b50-3ae2-445a-9e19-e7912529ebed None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:31.806099 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859b50-3ae2-445a-9e19-e7912529ebed None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:31.806375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859b50-3ae2-445a-9e19-e7912529ebed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:31.807128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:31.815130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:31.874405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db859b50-3ae2-445a-9e19-e7912529ebed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:31.875971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db859b50-3ae2-445a-9e19-e7912529ebed None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:31.894295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51f456-aafa-4d8a-b58b-93b46c3845bc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:31.928083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7d4e6-2e05-45a0-a664-41cc77844967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:31.928688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7d4e6-2e05-45a0-a664-41cc77844967 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:31.928970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7d4e6-2e05-45a0-a664-41cc77844967 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:31.929244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7d4e6-2e05-45a0-a664-41cc77844967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:31.974094 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 42/83] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:31.974094 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db859b50-3ae2-445a-9e19-e7912529ebed None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:31.997267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7d4e6-2e05-45a0-a664-41cc77844967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:31.999375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7d4e6-2e05-45a0-a664-41cc77844967 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:32.010113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:32.014750 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:32.074925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db859b50-3ae2-445a-9e19-e7912529ebed None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:32.096092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 42/84] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:32.096998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7d4e6-2e05-45a0-a664-41cc77844967 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:32.110121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debefef3-8fb5-44f6-8a1c-179c21d94c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:32.110759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debefef3-8fb5-44f6-8a1c-179c21d94c7d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:32.111147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debefef3-8fb5-44f6-8a1c-179c21d94c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:32.111312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debefef3-8fb5-44f6-8a1c-179c21d94c7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:32.112489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debefef3-8fb5-44f6-8a1c-179c21d94c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:32.113944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debefef3-8fb5-44f6-8a1c-179c21d94c7d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:32.115674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 43/85] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:32.116334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debefef3-8fb5-44f6-8a1c-179c21d94c7d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:32.195005 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7d4e6-2e05-45a0-a664-41cc77844967 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:32.205374 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:32.214626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debefef3-8fb5-44f6-8a1c-179c21d94c7d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:32.221430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:32.228508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829efab4-b6a4-47fa-81df-6879dcee19e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:32.229112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829efab4-b6a4-47fa-81df-6879dcee19e1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:32.229411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829efab4-b6a4-47fa-81df-6879dcee19e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:32.229670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829efab4-b6a4-47fa-81df-6879dcee19e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:32.230618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829efab4-b6a4-47fa-81df-6879dcee19e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:32.230925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829efab4-b6a4-47fa-81df-6879dcee19e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:32.232293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829efab4-b6a4-47fa-81df-6879dcee19e1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:32.240576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 43/86] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:32.241360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829efab4-b6a4-47fa-81df-6879dcee19e1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:32.252045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c783790-940f-4565-b9d9-dae3e4510be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:32.252710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c783790-940f-4565-b9d9-dae3e4510be8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:32.252970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c783790-940f-4565-b9d9-dae3e4510be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:32.253251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c783790-940f-4565-b9d9-dae3e4510be8 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:32.254426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c783790-940f-4565-b9d9-dae3e4510be8 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:32.255877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c783790-940f-4565-b9d9-dae3e4510be8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:32.257514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 44/87] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:32 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:32.258330 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c783790-940f-4565-b9d9-dae3e4510be8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:32.344170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829efab4-b6a4-47fa-81df-6879dcee19e1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:32.355011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c783790-940f-4565-b9d9-dae3e4510be8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:32.377179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df46a7f-b9ca-4f9f-9c03-e46de5e27fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:32.377818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df46a7f-b9ca-4f9f-9c03-e46de5e27fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:32.378119 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df46a7f-b9ca-4f9f-9c03-e46de5e27fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:32.378394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df46a7f-b9ca-4f9f-9c03-e46de5e27fc8 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:32.379516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df46a7f-b9ca-4f9f-9c03-e46de5e27fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:32.380962 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df46a7f-b9ca-4f9f-9c03-e46de5e27fc8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:32.382609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 44/88] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:32 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:32.383349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df46a7f-b9ca-4f9f-9c03-e46de5e27fc8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:32.392074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658490bf-fd21-4fa6-b2f9-b8d33610b963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:32.392703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658490bf-fd21-4fa6-b2f9-b8d33610b963 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:32.392982 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658490bf-fd21-4fa6-b2f9-b8d33610b963 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:32.393254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658490bf-fd21-4fa6-b2f9-b8d33610b963 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:32.394397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658490bf-fd21-4fa6-b2f9-b8d33610b963 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:32.395814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658490bf-fd21-4fa6-b2f9-b8d33610b963 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:32.397565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 45/89] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:32 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:32.398177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658490bf-fd21-4fa6-b2f9-b8d33610b963 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:32.428556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:32.441365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:32.488794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df46a7f-b9ca-4f9f-9c03-e46de5e27fc8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:32.497681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658490bf-fd21-4fa6-b2f9-b8d33610b963 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:32.520193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f72ef-7fc9-4c04-a634-306ce0633b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:32.520794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f72ef-7fc9-4c04-a634-306ce0633b7b None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:32.521074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f72ef-7fc9-4c04-a634-306ce0633b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:32.521346 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f72ef-7fc9-4c04-a634-306ce0633b7b None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:32.521987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f72ef-7fc9-4c04-a634-306ce0633b7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:32.523453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f72ef-7fc9-4c04-a634-306ce0633b7b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:32.536333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249e79-df2f-4169-9747-e165a14cc902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:32.536970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249e79-df2f-4169-9747-e165a14cc902 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:32.537253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249e79-df2f-4169-9747-e165a14cc902 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:32.537528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249e79-df2f-4169-9747-e165a14cc902 None admin] PATH_INFO: `/v3/users/8556ff7ce3fc415290dc56e1f7145ebd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:32.538680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d249e79-df2f-4169-9747-e165a14cc902 None admin] RBAC: Authorizing `identity:get_user(user_id=8556ff7ce3fc415290dc56e1f7145ebd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:32.540111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d249e79-df2f-4169-9747-e165a14cc902 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:32.541735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:32 2022] GET /identity/v3/users/8556ff7ce3fc415290dc56e1f7145ebd => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:32.542575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249e79-df2f-4169-9747-e165a14cc902 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:32.566059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 45/91] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:08:32 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:08:32.566059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f72ef-7fc9-4c04-a634-306ce0633b7b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:32.659865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249e79-df2f-4169-9747-e165a14cc902 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:32.663798 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:32.672512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:32.673094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f72ef-7fc9-4c04-a634-306ce0633b7b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:32.705753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5474d1-b22f-498c-af68-081685108735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:32.706415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5474d1-b22f-498c-af68-081685108735 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:32.706706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5474d1-b22f-498c-af68-081685108735 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:32.706989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5474d1-b22f-498c-af68-081685108735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:32.707791 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5474d1-b22f-498c-af68-081685108735 None admin] RBAC: Adding query filter params (role.id=924c0aaeca9d4fa6924529f3f93a2f7e, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57, user.id=8556ff7ce3fc415290dc56e1f7145ebd) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:32.708111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5474d1-b22f-498c-af68-081685108735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:32.709558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5474d1-b22f-498c-af68-081685108735 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:32.715672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e9d46-8a98-403d-a1fb-c0fb8121b7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:32.716422 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9d46-8a98-403d-a1fb-c0fb8121b7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:32.716558 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9d46-8a98-403d-a1fb-c0fb8121b7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:32.716881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9d46-8a98-403d-a1fb-c0fb8121b7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:32.718165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9d46-8a98-403d-a1fb-c0fb8121b7c5 None admin] RBAC: Adding query filter params (role.id=e4dc6d4cfce94e67aa327307e8bd4190, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57, user.id=8556ff7ce3fc415290dc56e1f7145ebd) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:32.719121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9d46-8a98-403d-a1fb-c0fb8121b7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:32.719224 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 47/92] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:32 2022] GET /identity/v3/role_assignments?user.id=8556ff7ce3fc415290dc56e1f7145ebd&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=924c0aaeca9d4fa6924529f3f93a2f7e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:32.719898 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5474d1-b22f-498c-af68-081685108735 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:32.720000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9d46-8a98-403d-a1fb-c0fb8121b7c5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:32.734132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 46/93] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:32 2022] GET /identity/v3/role_assignments?user.id=8556ff7ce3fc415290dc56e1f7145ebd&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:32.734132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e9d46-8a98-403d-a1fb-c0fb8121b7c5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:32.850524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5474d1-b22f-498c-af68-081685108735 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:32.860856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e9d46-8a98-403d-a1fb-c0fb8121b7c5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:32.894358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f00ad6-6aa1-47ec-aeee-73f9e403590c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:32.894999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00ad6-6aa1-47ec-aeee-73f9e403590c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:32.895284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00ad6-6aa1-47ec-aeee-73f9e403590c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:32.895563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00ad6-6aa1-47ec-aeee-73f9e403590c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:32.896442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f00ad6-6aa1-47ec-aeee-73f9e403590c None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57, user.id=9828bdee3ea64cec99e58fcb117e4cdd) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:32.896763 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f00ad6-6aa1-47ec-aeee-73f9e403590c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:32.898518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f00ad6-6aa1-47ec-aeee-73f9e403590c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:32.903841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348ecd5-ed8f-400f-844a-f5e814c70b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:32.905325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 48/94] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:32 2022] GET /identity/v3/role_assignments?user.id=9828bdee3ea64cec99e58fcb117e4cdd&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:32.905613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ecd5-ed8f-400f-844a-f5e814c70b2e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:32.906129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ecd5-ed8f-400f-844a-f5e814c70b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:32.906620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348ecd5-ed8f-400f-844a-f5e814c70b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:32.943484 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:32.993235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348ecd5-ed8f-400f-844a-f5e814c70b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:32.995324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348ecd5-ed8f-400f-844a-f5e814c70b2e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:33.113668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 47/95] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:33.119421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f00ad6-6aa1-47ec-aeee-73f9e403590c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:33.171435 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:33.242595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f00ad6-6aa1-47ec-aeee-73f9e403590c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:33.279034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508528a5-4c0a-464c-bbbe-de2821bbc612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:33.279707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508528a5-4c0a-464c-bbbe-de2821bbc612 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:33.279990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508528a5-4c0a-464c-bbbe-de2821bbc612 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:33.280263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508528a5-4c0a-464c-bbbe-de2821bbc612 None admin] PATH_INFO: `/v3/projects/28389a16727f43d9bfc0a862bc788460` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:33.281437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508528a5-4c0a-464c-bbbe-de2821bbc612 None admin] RBAC: Authorizing `identity:get_project(project_id=28389a16727f43d9bfc0a862bc788460)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:33.282914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508528a5-4c0a-464c-bbbe-de2821bbc612 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:33.284547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 49/96] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:33 2022] GET /identity/v3/projects/28389a16727f43d9bfc0a862bc788460 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:33.292484 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348ecd5-ed8f-400f-844a-f5e814c70b2e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:33.375935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:33.430961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348ecd5-ed8f-400f-844a-f5e814c70b2e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:33.475037 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf2eb2-cd40-41a8-a922-0d7f9ad1125a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:33.475890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf2eb2-cd40-41a8-a922-0d7f9ad1125a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:33.476320 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf2eb2-cd40-41a8-a922-0d7f9ad1125a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:33.476742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf2eb2-cd40-41a8-a922-0d7f9ad1125a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:33.477612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf2eb2-cd40-41a8-a922-0d7f9ad1125a None admin] RBAC: Adding query filter params (role.id=e4dc6d4cfce94e67aa327307e8bd4190, scope.project.id=28389a16727f43d9bfc0a862bc788460, user.id=8556ff7ce3fc415290dc56e1f7145ebd) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:33.478115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf2eb2-cd40-41a8-a922-0d7f9ad1125a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:33.479957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf2eb2-cd40-41a8-a922-0d7f9ad1125a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:33.486431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 48/97] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:33 2022] GET /identity/v3/role_assignments?user.id=8556ff7ce3fc415290dc56e1f7145ebd&scope.project.id=28389a16727f43d9bfc0a862bc788460&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:35.083628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45305d61-efe9-4f93-b2fd-668d0edd695c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:35.084655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45305d61-efe9-4f93-b2fd-668d0edd695c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:35.085145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45305d61-efe9-4f93-b2fd-668d0edd695c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:35.086736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 50/98] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:35.092776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b533d-2829-491a-8fc7-af40ea53081e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:35.093606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b533d-2829-491a-8fc7-af40ea53081e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:35.094147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b533d-2829-491a-8fc7-af40ea53081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:35.123107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c51b533d-2829-491a-8fc7-af40ea53081e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:35.124677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c51b533d-2829-491a-8fc7-af40ea53081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:35.183045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03407b-7701-4352-bb29-df6d31340d95 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:35.183681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03407b-7701-4352-bb29-df6d31340d95 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:35.184200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03407b-7701-4352-bb29-df6d31340d95 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:35.185882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 51/99] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:08:35.194181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9df13-74b7-4a80-a0b7-7a3cf70b005c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:35.194181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9df13-74b7-4a80-a0b7-7a3cf70b005c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:35.194181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9df13-74b7-4a80-a0b7-7a3cf70b005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:35.215204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-28c9df13-74b7-4a80-a0b7-7a3cf70b005c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:35.217690 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-28c9df13-74b7-4a80-a0b7-7a3cf70b005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:35.236343 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 49/100] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:35.343762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 52/101] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:35.713898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b5a72-a759-4b80-8cd7-dcbd7738d4c8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:35.713898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b5a72-a759-4b80-8cd7-dcbd7738d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:35.713898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b5a72-a759-4b80-8cd7-dcbd7738d4c8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:35.713898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 50/102] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:35.718519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1818ae1-3c42-4889-9852-76559743bda9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:35.718811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1818ae1-3c42-4889-9852-76559743bda9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:35.719094 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1818ae1-3c42-4889-9852-76559743bda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:35.751215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e1818ae1-3c42-4889-9852-76559743bda9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:35.752468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e1818ae1-3c42-4889-9852-76559743bda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:35.770859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b5a72-a759-4b80-8cd7-dcbd7738d4c8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:35.798388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:35.855456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 53/103] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:35.856719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1818ae1-3c42-4889-9852-76559743bda9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:35.924895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:36.024786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1818ae1-3c42-4889-9852-76559743bda9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:36.027754 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b5a72-a759-4b80-8cd7-dcbd7738d4c8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:36.087448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1ac51-87b7-4466-95df-42a3a3a8052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:36.088740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1ac51-87b7-4466-95df-42a3a3a8052f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.089486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1ac51-87b7-4466-95df-42a3a3a8052f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.090434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1ac51-87b7-4466-95df-42a3a3a8052f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.091643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41d25b-cdd1-4a26-aaa6-76adc959e49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:36.092660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d25b-cdd1-4a26-aaa6-76adc959e49d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.094182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d25b-cdd1-4a26-aaa6-76adc959e49d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.095062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d25b-cdd1-4a26-aaa6-76adc959e49d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.109688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1ac51-87b7-4466-95df-42a3a3a8052f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:36.111609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41d25b-cdd1-4a26-aaa6-76adc959e49d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f7d1ac51-87b7-4466-95df-42a3a3a8052f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:36.115069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:36.116083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:36.117035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7b41d25b-cdd1-4a26-aaa6-76adc959e49d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:36.117614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:36.118467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:36.119334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:36.121131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 54/105] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:08:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:36.122651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 51/105] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:36.123805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffe5f-f14f-470b-95aa-485385fff2a2 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.124236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffe5f-f14f-470b-95aa-485385fff2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.124658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ffe5f-f14f-470b-95aa-485385fff2a2 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.125627 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8ceba-705c-4d16-a327-7d0ffc063aa7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.125922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8ceba-705c-4d16-a327-7d0ffc063aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.126453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a8ceba-705c-4d16-a327-7d0ffc063aa7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.126722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 55/106] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:36.127447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ffe5f-f14f-470b-95aa-485385fff2a2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:36.128189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 52/107] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:36.129125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8ceba-705c-4d16-a327-7d0ffc063aa7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:36.164948 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:36.241209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a8ceba-705c-4d16-a327-7d0ffc063aa7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:36.247033 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ffe5f-f14f-470b-95aa-485385fff2a2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:36.256735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:36.282682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccd979-6ee9-49c1-8538-5f50b714c550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:36.283202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e38152-2a59-4d7c-9c55-fb8df543bf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:36.283539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccd979-6ee9-49c1-8538-5f50b714c550 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.283828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccd979-6ee9-49c1-8538-5f50b714c550 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.284111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccd979-6ee9-49c1-8538-5f50b714c550 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.284438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38152-2a59-4d7c-9c55-fb8df543bf42 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.284788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccd979-6ee9-49c1-8538-5f50b714c550 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:36.285001 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38152-2a59-4d7c-9c55-fb8df543bf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.285103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccd979-6ee9-49c1-8538-5f50b714c550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:36.285487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38152-2a59-4d7c-9c55-fb8df543bf42 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.286330 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e38152-2a59-4d7c-9c55-fb8df543bf42 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:36.286552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccd979-6ee9-49c1-8538-5f50b714c550 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:36.286910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e38152-2a59-4d7c-9c55-fb8df543bf42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:36.288397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e38152-2a59-4d7c-9c55-fb8df543bf42 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:36.295107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 53/108] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:08:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:36.295107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff173a4-c100-4a0d-9a41-b636bc8a4ac4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.295107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff173a4-c100-4a0d-9a41-b636bc8a4ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.295107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff173a4-c100-4a0d-9a41-b636bc8a4ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.302298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 56/109] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:36.307628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910b242-2ac7-4679-a948-46e858a86a21 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.307944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910b242-2ac7-4679-a948-46e858a86a21 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.308203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910b242-2ac7-4679-a948-46e858a86a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.315129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5ff173a4-c100-4a0d-9a41-b636bc8a4ac4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:36.316450 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5ff173a4-c100-4a0d-9a41-b636bc8a4ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:36.327502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1910b242-2ac7-4679-a948-46e858a86a21 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:36.328732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1910b242-2ac7-4679-a948-46e858a86a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:36.386098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 54/110] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:36.394224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff173a4-c100-4a0d-9a41-b636bc8a4ac4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:36.411046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 57/111] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:36.414896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910b242-2ac7-4679-a948-46e858a86a21 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:36.449470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:36.536743 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff173a4-c100-4a0d-9a41-b636bc8a4ac4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:36.556309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:36.577670 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910b242-2ac7-4679-a948-46e858a86a21 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:36.581663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ff49d-2e04-4fb0-8197-057f2a9a1ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:36.582605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ff49d-2e04-4fb0-8197-057f2a9a1ddf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.582965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ff49d-2e04-4fb0-8197-057f2a9a1ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.583312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ff49d-2e04-4fb0-8197-057f2a9a1ddf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.597319 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ff49d-2e04-4fb0-8197-057f2a9a1ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0f2ff49d-2e04-4fb0-8197-057f2a9a1ddf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:36.603707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:36.604985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:08:36.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:36.610177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:36.611083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ff49d-2e04-4fb0-8197-057f2a9a1ddf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:36.624577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d1972-26f0-4784-8ad9-cb127ec55bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:36.625246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d1972-26f0-4784-8ad9-cb127ec55bff None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.625529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d1972-26f0-4784-8ad9-cb127ec55bff None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.625806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d1972-26f0-4784-8ad9-cb127ec55bff None admin] PATH_INFO: `/v3/users/8556ff7ce3fc415290dc56e1f7145ebd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.627109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d1972-26f0-4784-8ad9-cb127ec55bff None admin] RBAC: Authorizing `identity:get_user(user_id=8556ff7ce3fc415290dc56e1f7145ebd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:36.628571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d1972-26f0-4784-8ad9-cb127ec55bff None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:36.630388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 58/113] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:36 2022] GET /identity/v3/users/8556ff7ce3fc415290dc56e1f7145ebd => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:36.636067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7d205-2b49-4aa0-88bb-ed35a97cb96e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.636362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7d205-2b49-4aa0-88bb-ed35a97cb96e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.636645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7d205-2b49-4aa0-88bb-ed35a97cb96e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.641823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 59/114] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:36.641823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7d205-2b49-4aa0-88bb-ed35a97cb96e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:36.735416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:36.736145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ff49d-2e04-4fb0-8197-057f2a9a1ddf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:36.751734 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7d205-2b49-4aa0-88bb-ed35a97cb96e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:36.769776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d0cf8-38a8-458e-9a9e-825c211b3676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:36.770439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d0cf8-38a8-458e-9a9e-825c211b3676 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.770721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d0cf8-38a8-458e-9a9e-825c211b3676 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.770995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d0cf8-38a8-458e-9a9e-825c211b3676 None admin] PATH_INFO: `/v3/users/8556ff7ce3fc415290dc56e1f7145ebd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.772120 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d0cf8-38a8-458e-9a9e-825c211b3676 None admin] RBAC: Authorizing `identity:get_user(user_id=8556ff7ce3fc415290dc56e1f7145ebd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:36.773683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d0cf8-38a8-458e-9a9e-825c211b3676 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:36.775367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 56/115] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:36 2022] GET /identity/v3/users/8556ff7ce3fc415290dc56e1f7145ebd => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:36.775916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d0cf8-38a8-458e-9a9e-825c211b3676 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:36.789072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba795c51-c9ea-455d-b3a6-50d2cb9035d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:36.789772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba795c51-c9ea-455d-b3a6-50d2cb9035d3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.790087 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba795c51-c9ea-455d-b3a6-50d2cb9035d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.790369 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba795c51-c9ea-455d-b3a6-50d2cb9035d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.791043 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba795c51-c9ea-455d-b3a6-50d2cb9035d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:36.791360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba795c51-c9ea-455d-b3a6-50d2cb9035d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:36.792724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba795c51-c9ea-455d-b3a6-50d2cb9035d3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:36.801251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 60/116] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:36.802413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e3504-93c4-4722-92aa-c68611bab103 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.802862 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e3504-93c4-4722-92aa-c68611bab103 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.803147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e3504-93c4-4722-92aa-c68611bab103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.810091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:36.820778 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-712e3504-93c4-4722-92aa-c68611bab103 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:36.821987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-712e3504-93c4-4722-92aa-c68611bab103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:36.874846 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d0cf8-38a8-458e-9a9e-825c211b3676 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:36.898073 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 61/117] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:36.898073 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e3504-93c4-4722-92aa-c68611bab103 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:36.920886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac641c3-6c3c-44e3-bbce-2964f25fd1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:36.921541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac641c3-6c3c-44e3-bbce-2964f25fd1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:36.921822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac641c3-6c3c-44e3-bbce-2964f25fd1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:36.922126 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac641c3-6c3c-44e3-bbce-2964f25fd1a4 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:36.923238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac641c3-6c3c-44e3-bbce-2964f25fd1a4 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:36.924843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac641c3-6c3c-44e3-bbce-2964f25fd1a4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:36.926633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 57/118] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:36 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:36.927231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac641c3-6c3c-44e3-bbce-2964f25fd1a4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:36.977272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:37.002444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e3504-93c4-4722-92aa-c68611bab103 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:37.030772 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac641c3-6c3c-44e3-bbce-2964f25fd1a4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:37.032262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:37.041331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7712c-cab5-4f37-ba9a-6cf4fb182565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:37.042016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7712c-cab5-4f37-ba9a-6cf4fb182565 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:37.042337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7712c-cab5-4f37-ba9a-6cf4fb182565 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:37.042607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7712c-cab5-4f37-ba9a-6cf4fb182565 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:37.053598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7712c-cab5-4f37-ba9a-6cf4fb182565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-61c7712c-cab5-4f37-ba9a-6cf4fb182565 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:37.058371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:37.059191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:37.059919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 62/119] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:08:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:37.060560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7712c-cab5-4f37-ba9a-6cf4fb182565 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:37.070905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9c2ac-2bf2-47f7-aac5-629c22d4d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:37.071542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9c2ac-2bf2-47f7-aac5-629c22d4d3ab None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:37.071833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9c2ac-2bf2-47f7-aac5-629c22d4d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:37.072113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9c2ac-2bf2-47f7-aac5-629c22d4d3ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:37.073224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9c2ac-2bf2-47f7-aac5-629c22d4d3ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:37.074711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9c2ac-2bf2-47f7-aac5-629c22d4d3ab None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:37.076301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 58/120] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:37.077054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9c2ac-2bf2-47f7-aac5-629c22d4d3ab None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:37.172108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7712c-cab5-4f37-ba9a-6cf4fb182565 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:37.177641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9c2ac-2bf2-47f7-aac5-629c22d4d3ab None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:37.205488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d7401-2081-4944-8e48-c7afb42c3392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:37.206182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7401-2081-4944-8e48-c7afb42c3392 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:37.206467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7401-2081-4944-8e48-c7afb42c3392 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:37.206744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d7401-2081-4944-8e48-c7afb42c3392 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:37.207876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d7401-2081-4944-8e48-c7afb42c3392 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:37.209338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d7401-2081-4944-8e48-c7afb42c3392 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:37.210989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 63/121] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:37 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:37.211454 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923150a-84d0-40ed-9600-80f4db93c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:37.212164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923150a-84d0-40ed-9600-80f4db93c855 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:37.212456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923150a-84d0-40ed-9600-80f4db93c855 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:37.212737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923150a-84d0-40ed-9600-80f4db93c855 None admin] PATH_INFO: `/v3/users/ebb374c1123a4b1c94213c0f77129cf5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:37.214878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d7401-2081-4944-8e48-c7afb42c3392 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:37.224544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:37.227733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923150a-84d0-40ed-9600-80f4db93c855 None admin] RBAC: Authorizing `identity:get_user(user_id=ebb374c1123a4b1c94213c0f77129cf5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:37.229365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923150a-84d0-40ed-9600-80f4db93c855 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:37.231393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 59/122] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:37 2022] GET /identity/v3/users/ebb374c1123a4b1c94213c0f77129cf5 => generated 289 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:37.232165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923150a-84d0-40ed-9600-80f4db93c855 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:37.262516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:37.316105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d7401-2081-4944-8e48-c7afb42c3392 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:37.334004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923150a-84d0-40ed-9600-80f4db93c855 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:37.349190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e6531-7fb1-4b67-97df-45630ca3704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:37.349854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6531-7fb1-4b67-97df-45630ca3704f None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:37.350184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6531-7fb1-4b67-97df-45630ca3704f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:37.350463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e6531-7fb1-4b67-97df-45630ca3704f None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/users/8556ff7ce3fc415290dc56e1f7145ebd/roles/924c0aaeca9d4fa6924529f3f93a2f7e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:37.352635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e6531-7fb1-4b67-97df-45630ca3704f None admin] RBAC: Authorizing `identity:create_grant(project_id=a4b53680965d437990ee6e4f6a6dbc57, user_id=8556ff7ce3fc415290dc56e1f7145ebd, role_id=924c0aaeca9d4fa6924529f3f93a2f7e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:37.354118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e6531-7fb1-4b67-97df-45630ca3704f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:37.367510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 64/123] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:08:37 2022] PUT /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/users/8556ff7ce3fc415290dc56e1f7145ebd/roles/924c0aaeca9d4fa6924529f3f93a2f7e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:08:37.368032 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e6531-7fb1-4b67-97df-45630ca3704f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:37.368131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e133acd-0edb-4a44-abab-bef74fd7c510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:37.368771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e133acd-0edb-4a44-abab-bef74fd7c510 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:37.369064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e133acd-0edb-4a44-abab-bef74fd7c510 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:37.369342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e133acd-0edb-4a44-abab-bef74fd7c510 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:37.370079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e133acd-0edb-4a44-abab-bef74fd7c510 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:37.370396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e133acd-0edb-4a44-abab-bef74fd7c510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:37.371806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e133acd-0edb-4a44-abab-bef74fd7c510 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:37.381173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 60/124] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:37.382235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e133acd-0edb-4a44-abab-bef74fd7c510 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:37.441963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:37.482624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e6531-7fb1-4b67-97df-45630ca3704f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:37.493391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:37.505219 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e133acd-0edb-4a44-abab-bef74fd7c510 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:37.525852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d21cfb-afda-4428-810f-20c524086898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:37.526550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d21cfb-afda-4428-810f-20c524086898 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:37.526838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d21cfb-afda-4428-810f-20c524086898 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:37.527117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d21cfb-afda-4428-810f-20c524086898 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:37.527769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d21cfb-afda-4428-810f-20c524086898 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:37.530092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d21cfb-afda-4428-810f-20c524086898 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:37.544694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c783fe4-5627-4726-b556-7837d1707ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:37.545589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c783fe4-5627-4726-b556-7837d1707ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:37.546101 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c783fe4-5627-4726-b556-7837d1707ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:37.546531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c783fe4-5627-4726-b556-7837d1707ab2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:37.558408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 65/125] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:08:37 2022] POST /identity/v3/projects => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:08:37.560079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c783fe4-5627-4726-b556-7837d1707ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:37.562901 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d21cfb-afda-4428-810f-20c524086898 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6c783fe4-5627-4726-b556-7837d1707ab2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:37.566177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:37.567184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:37.567941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 61/126] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:37.568585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c783fe4-5627-4726-b556-7837d1707ab2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:37.699196 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d21cfb-afda-4428-810f-20c524086898 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:37.720957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c783fe4-5627-4726-b556-7837d1707ab2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:37.725253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:37.750497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a167c-5768-4f43-9488-b11ceb237355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:37.751464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a167c-5768-4f43-9488-b11ceb237355 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:37.751749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a167c-5768-4f43-9488-b11ceb237355 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:37.752026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a167c-5768-4f43-9488-b11ceb237355 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/users/8556ff7ce3fc415290dc56e1f7145ebd/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:37.753959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a167c-5768-4f43-9488-b11ceb237355 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4b53680965d437990ee6e4f6a6dbc57, user_id=8556ff7ce3fc415290dc56e1f7145ebd, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:37.755481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a167c-5768-4f43-9488-b11ceb237355 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:37.767406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317b6c3-d806-477d-a8d9-2939a91ec128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:37.768341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317b6c3-d806-477d-a8d9-2939a91ec128 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:37.768805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317b6c3-d806-477d-a8d9-2939a91ec128 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:37.769092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317b6c3-d806-477d-a8d9-2939a91ec128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:37.776787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 66/127] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:08:37 2022] PUT /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/users/8556ff7ce3fc415290dc56e1f7145ebd/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:08:37.777499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a167c-5768-4f43-9488-b11ceb237355 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:37.790999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:37.869436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317b6c3-d806-477d-a8d9-2939a91ec128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:37.870921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317b6c3-d806-477d-a8d9-2939a91ec128 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:37.952551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a167c-5768-4f43-9488-b11ceb237355 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:37.995436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01e038-d269-4736-a83f-627e28525b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:37.996192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01e038-d269-4736-a83f-627e28525b3e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:37.996487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01e038-d269-4736-a83f-627e28525b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:37.996827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01e038-d269-4736-a83f-627e28525b3e None admin] PATH_INFO: `/v3/users/9828bdee3ea64cec99e58fcb117e4cdd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:38.000606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01e038-d269-4736-a83f-627e28525b3e None admin] RBAC: Authorizing `identity:get_user(user_id=9828bdee3ea64cec99e58fcb117e4cdd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:38.002103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01e038-d269-4736-a83f-627e28525b3e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:38.004005 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 67/128] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:37 2022] GET /identity/v3/users/9828bdee3ea64cec99e58fcb117e4cdd => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:38.005143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01e038-d269-4736-a83f-627e28525b3e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:38.023500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 62/129] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:38.024371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317b6c3-d806-477d-a8d9-2939a91ec128 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:38.063339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:38.110602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:38.132358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01e038-d269-4736-a83f-627e28525b3e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:38.166892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe9abf-5f3e-468a-8c71-805dfbba5f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:38.167512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe9abf-5f3e-468a-8c71-805dfbba5f39 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:38.167790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe9abf-5f3e-468a-8c71-805dfbba5f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:38.168066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe9abf-5f3e-468a-8c71-805dfbba5f39 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:38.168741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe9abf-5f3e-468a-8c71-805dfbba5f39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:38.169044 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe9abf-5f3e-468a-8c71-805dfbba5f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:38.170970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe9abf-5f3e-468a-8c71-805dfbba5f39 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:38.179524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 68/130] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:38.180153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe9abf-5f3e-468a-8c71-805dfbba5f39 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:38.197100 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317b6c3-d806-477d-a8d9-2939a91ec128 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:38.262866 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b891e-7254-4b9d-937a-dc829cdaad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:38.263947 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b891e-7254-4b9d-937a-dc829cdaad44 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:38.264459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b891e-7254-4b9d-937a-dc829cdaad44 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:38.264977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b891e-7254-4b9d-937a-dc829cdaad44 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:38.268745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b891e-7254-4b9d-937a-dc829cdaad44 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:38.270509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b891e-7254-4b9d-937a-dc829cdaad44 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:38.272756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 63/131] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:38 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:38.273831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b891e-7254-4b9d-937a-dc829cdaad44 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:38.297193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe9abf-5f3e-468a-8c71-805dfbba5f39 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:38.305538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:38.375659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5b9a8-6fb0-4498-b081-a5621d628218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:38.376315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5b9a8-6fb0-4498-b081-a5621d628218 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:38.376605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5b9a8-6fb0-4498-b081-a5621d628218 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:38.376883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5b9a8-6fb0-4498-b081-a5621d628218 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:38.378042 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5b9a8-6fb0-4498-b081-a5621d628218 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:38.379499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5b9a8-6fb0-4498-b081-a5621d628218 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:38.381309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 69/132] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:38 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:38.381891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5b9a8-6fb0-4498-b081-a5621d628218 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:38.409100 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b891e-7254-4b9d-937a-dc829cdaad44 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:38.430762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:38.447823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3bc24-d632-4539-97f7-99cd929e1d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:38.448119 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3bc24-d632-4539-97f7-99cd929e1d4a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:38.448401 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3bc24-d632-4539-97f7-99cd929e1d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:38.448676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3bc24-d632-4539-97f7-99cd929e1d4a None admin] PATH_INFO: `/v3/users/8556ff7ce3fc415290dc56e1f7145ebd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:38.449821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3bc24-d632-4539-97f7-99cd929e1d4a None admin] RBAC: Authorizing `identity:get_user(user_id=8556ff7ce3fc415290dc56e1f7145ebd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:38.451351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3bc24-d632-4539-97f7-99cd929e1d4a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:38.453393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 64/133] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:38 2022] GET /identity/v3/users/8556ff7ce3fc415290dc56e1f7145ebd => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:38.454372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3bc24-d632-4539-97f7-99cd929e1d4a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:38.626510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5b9a8-6fb0-4498-b081-a5621d628218 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:38.645566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3bc24-d632-4539-97f7-99cd929e1d4a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:38.697663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a76d8a-d6e8-40af-ad86-1dd27ccef40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:38.698512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a76d8a-d6e8-40af-ad86-1dd27ccef40c None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:38.698620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a76d8a-d6e8-40af-ad86-1dd27ccef40c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:38.698896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a76d8a-d6e8-40af-ad86-1dd27ccef40c None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/users/9828bdee3ea64cec99e58fcb117e4cdd/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:38.707460 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a76d8a-d6e8-40af-ad86-1dd27ccef40c None admin] RBAC: Authorizing `identity:create_grant(project_id=a4b53680965d437990ee6e4f6a6dbc57, user_id=9828bdee3ea64cec99e58fcb117e4cdd, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:38.708991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a76d8a-d6e8-40af-ad86-1dd27ccef40c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:38.710815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ebd25-43f4-482c-a909-aabb904aaacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:38.711701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ebd25-43f4-482c-a909-aabb904aaacc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:38.712232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ebd25-43f4-482c-a909-aabb904aaacc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:38.712675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ebd25-43f4-482c-a909-aabb904aaacc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:38.713667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ebd25-43f4-482c-a909-aabb904aaacc None admin] RBAC: Adding query filter params (role.id=2263be67ab644cd1bc02a99e16e1b369, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57, user.id=ebb374c1123a4b1c94213c0f77129cf5) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:38.714264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ebd25-43f4-482c-a909-aabb904aaacc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:38.717268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ebd25-43f4-482c-a909-aabb904aaacc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:38.723403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 65/134] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:38 2022] GET /identity/v3/role_assignments?user.id=ebb374c1123a4b1c94213c0f77129cf5&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=2263be67ab644cd1bc02a99e16e1b369 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:38.724373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ebd25-43f4-482c-a909-aabb904aaacc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:38.756562 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 70/135] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:08:38 2022] PUT /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/users/9828bdee3ea64cec99e58fcb117e4cdd/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:08:38.822529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:38.927510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ebd25-43f4-482c-a909-aabb904aaacc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:38.995026 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913fe6b-546d-4ab1-813e-230c91df2527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:38.996000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913fe6b-546d-4ab1-813e-230c91df2527 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:38.996465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913fe6b-546d-4ab1-813e-230c91df2527 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:38.996940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913fe6b-546d-4ab1-813e-230c91df2527 None admin] PATH_INFO: `/v3/projects/28389a16727f43d9bfc0a862bc788460` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:38.999057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913fe6b-546d-4ab1-813e-230c91df2527 None admin] RBAC: Authorizing `identity:get_project(project_id=28389a16727f43d9bfc0a862bc788460)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:39.000727 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913fe6b-546d-4ab1-813e-230c91df2527 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:39.002986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 66/136] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:38 2022] GET /identity/v3/projects/28389a16727f43d9bfc0a862bc788460 => generated 312 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:39.010050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a76d8a-d6e8-40af-ad86-1dd27ccef40c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:39.096077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:39.243070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a76d8a-d6e8-40af-ad86-1dd27ccef40c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:39.335677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72345c4d-daa3-4635-b952-734816a0c6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:39.336362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345c4d-daa3-4635-b952-734816a0c6ed None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:39.336654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345c4d-daa3-4635-b952-734816a0c6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:39.336933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72345c4d-daa3-4635-b952-734816a0c6ed None admin] PATH_INFO: `/v3/projects/28389a16727f43d9bfc0a862bc788460/users/8556ff7ce3fc415290dc56e1f7145ebd/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:39.340143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72345c4d-daa3-4635-b952-734816a0c6ed None admin] RBAC: Authorizing `identity:create_grant(project_id=28389a16727f43d9bfc0a862bc788460, user_id=8556ff7ce3fc415290dc56e1f7145ebd, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:39.342233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72345c4d-daa3-4635-b952-734816a0c6ed None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:39.384428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 71/137] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:08:39 2022] PUT /identity/v3/projects/28389a16727f43d9bfc0a862bc788460/users/8556ff7ce3fc415290dc56e1f7145ebd/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:08:39.866709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5634f5e-72fd-4b44-99d2-c549df5674e6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:39.867215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5634f5e-72fd-4b44-99d2-c549df5674e6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:39.867288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5634f5e-72fd-4b44-99d2-c549df5674e6 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:39.868848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 67/138] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:39.874311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f6fc4-b1c9-472d-ad98-3d54426ee890 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:39.874603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f6fc4-b1c9-472d-ad98-3d54426ee890 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:39.874881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f6fc4-b1c9-472d-ad98-3d54426ee890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:39.898990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-739f6fc4-b1c9-472d-ad98-3d54426ee890 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:39.900187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-739f6fc4-b1c9-472d-ad98-3d54426ee890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:39.995320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 72/139] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:40.220622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405e023-2b76-4a26-aee3-0781d21fb628 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:40.220954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405e023-2b76-4a26-aee3-0781d21fb628 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:40.221134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405e023-2b76-4a26-aee3-0781d21fb628 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:40.222629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 68/140] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:40.227769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd336-878b-437e-b146-5efe679a7220 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:40.228068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd336-878b-437e-b146-5efe679a7220 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:40.228342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd336-878b-437e-b146-5efe679a7220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:40.247261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c17dd336-878b-437e-b146-5efe679a7220 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:40.249018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c17dd336-878b-437e-b146-5efe679a7220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:40.270774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:40.322908 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 73/141] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:40.536803 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405e023-2b76-4a26-aee3-0781d21fb628 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:40.551827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069aa47-0dab-4f89-aa36-10a321958403 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:40.551827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069aa47-0dab-4f89-aa36-10a321958403 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:40.552045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069aa47-0dab-4f89-aa36-10a321958403 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:40.555582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 74/142] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:40.561303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf10f54-f66b-46d5-bd2b-2413301a5bfb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:40.561586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf10f54-f66b-46d5-bd2b-2413301a5bfb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:40.561861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf10f54-f66b-46d5-bd2b-2413301a5bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:40.596065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-adf10f54-f66b-46d5-bd2b-2413301a5bfb None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:40.597248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-adf10f54-f66b-46d5-bd2b-2413301a5bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:40.723260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405e023-2b76-4a26-aee3-0781d21fb628 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:40.724878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 75/143] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:40.725740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf10f54-f66b-46d5-bd2b-2413301a5bfb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:40.762389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:40.801932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2a4bc-cecf-43fd-bc70-9ca7a43f5a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:40.802535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2a4bc-cecf-43fd-bc70-9ca7a43f5a70 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:40.802816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2a4bc-cecf-43fd-bc70-9ca7a43f5a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:40.803091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2a4bc-cecf-43fd-bc70-9ca7a43f5a70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:40.824063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2a4bc-cecf-43fd-bc70-9ca7a43f5a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a3e2a4bc-cecf-43fd-bc70-9ca7a43f5a70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:40.833834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:40.834693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:40.835474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 69/144] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:08:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:40.843714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2a4bc-cecf-43fd-bc70-9ca7a43f5a70 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:40.870493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:40.890375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf10f54-f66b-46d5-bd2b-2413301a5bfb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:40.974884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b7dd-85fc-494f-afb2-b570181f9e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:40.975542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b7dd-85fc-494f-afb2-b570181f9e5a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:40.975824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b7dd-85fc-494f-afb2-b570181f9e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:40.976101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466b7dd-85fc-494f-afb2-b570181f9e5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:40.977271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466b7dd-85fc-494f-afb2-b570181f9e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:40.978867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466b7dd-85fc-494f-afb2-b570181f9e5a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:40.980706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 76/145] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:40.986282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b7dd-85fc-494f-afb2-b570181f9e5a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:41.044295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2a4bc-cecf-43fd-bc70-9ca7a43f5a70 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:41.119487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bf9e5-c879-455a-afd7-bde0290d4939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:41.120031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bf9e5-c879-455a-afd7-bde0290d4939 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:41.120316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bf9e5-c879-455a-afd7-bde0290d4939 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:41.120594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bf9e5-c879-455a-afd7-bde0290d4939 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:41.121746 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bf9e5-c879-455a-afd7-bde0290d4939 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:41.122081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bf9e5-c879-455a-afd7-bde0290d4939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:41.123539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bf9e5-c879-455a-afd7-bde0290d4939 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:41.137366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 70/146] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:08:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:41.143556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bf9e5-c879-455a-afd7-bde0290d4939 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:41.191152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:41.211974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466b7dd-85fc-494f-afb2-b570181f9e5a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:41.248827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bf9e5-c879-455a-afd7-bde0290d4939 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:41.287500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270732ae-8cec-4d1f-97a0-060dd31c2022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:41.288541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270732ae-8cec-4d1f-97a0-060dd31c2022 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:41.289014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270732ae-8cec-4d1f-97a0-060dd31c2022 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:41.289476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270732ae-8cec-4d1f-97a0-060dd31c2022 None admin] PATH_INFO: `/v3/users/8556ff7ce3fc415290dc56e1f7145ebd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:41.290847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270732ae-8cec-4d1f-97a0-060dd31c2022 None admin] RBAC: Authorizing `identity:get_user(user_id=8556ff7ce3fc415290dc56e1f7145ebd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:41.291022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9edd5-987f-478a-bd11-a270daadead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:41.292156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9edd5-987f-478a-bd11-a270daadead1 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:41.292574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9edd5-987f-478a-bd11-a270daadead1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:41.292797 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270732ae-8cec-4d1f-97a0-060dd31c2022 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:41.293164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9edd5-987f-478a-bd11-a270daadead1 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:41.293965 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9edd5-987f-478a-bd11-a270daadead1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:41.294886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 71/147] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:41 2022] GET /identity/v3/users/8556ff7ce3fc415290dc56e1f7145ebd => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:41.295567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270732ae-8cec-4d1f-97a0-060dd31c2022 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:41.296251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9edd5-987f-478a-bd11-a270daadead1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:41.339033 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 77/148] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:08:40 2022] POST /identity/v3/users => generated 283 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:08:41.340224 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9edd5-987f-478a-bd11-a270daadead1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:41.367827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:41.404878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270732ae-8cec-4d1f-97a0-060dd31c2022 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:41.414871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:41.442267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ba6e4-2b0b-4ddc-ad0f-d4185779d4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:41.443144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ba6e4-2b0b-4ddc-ad0f-d4185779d4fc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:41.443535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ba6e4-2b0b-4ddc-ad0f-d4185779d4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:41.443924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ba6e4-2b0b-4ddc-ad0f-d4185779d4fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:41.456486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ba6e4-2b0b-4ddc-ad0f-d4185779d4fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e13ba6e4-2b0b-4ddc-ad0f-d4185779d4fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:41.461538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:41.462511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:41.463296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 72/149] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:41.471902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ba6e4-2b0b-4ddc-ad0f-d4185779d4fc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:41.538509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9edd5-987f-478a-bd11-a270daadead1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:41.589762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba074-8f24-42d7-8f7b-c84fc91f48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:41.590572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba074-8f24-42d7-8f7b-c84fc91f48e0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:41.590973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba074-8f24-42d7-8f7b-c84fc91f48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:41.591332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba074-8f24-42d7-8f7b-c84fc91f48e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:41.634729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ba6e4-2b0b-4ddc-ad0f-d4185779d4fc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:41.674278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9748d15-2cb5-4ba0-85e6-68a156e39eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:41.675043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9748d15-2cb5-4ba0-85e6-68a156e39eaa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:41.675681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9748d15-2cb5-4ba0-85e6-68a156e39eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:41.676102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9748d15-2cb5-4ba0-85e6-68a156e39eaa None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:41.676588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ba074-8f24-42d7-8f7b-c84fc91f48e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:41.676961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9748d15-2cb5-4ba0-85e6-68a156e39eaa None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:41.677378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9748d15-2cb5-4ba0-85e6-68a156e39eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:41.678564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ba074-8f24-42d7-8f7b-c84fc91f48e0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:41.678970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9748d15-2cb5-4ba0-85e6-68a156e39eaa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:41.691098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 73/150] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:41.692900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa97c4-0127-434e-82c5-536182cfc06b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:41.693283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa97c4-0127-434e-82c5-536182cfc06b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:41.693597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:41.693707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa97c4-0127-434e-82c5-536182cfc06b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:41.696134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 74/151] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:41.697110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa97c4-0127-434e-82c5-536182cfc06b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:41.733756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:41.799699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 78/152] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:41.801122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a347c17-3c52-4db2-ac7d-f74e2ce1e39f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:41.801502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a347c17-3c52-4db2-ac7d-f74e2ce1e39f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:41.801937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a347c17-3c52-4db2-ac7d-f74e2ce1e39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:41.824073 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1a347c17-3c52-4db2-ac7d-f74e2ce1e39f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:41.825329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa97c4-0127-434e-82c5-536182cfc06b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:41.825599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1a347c17-3c52-4db2-ac7d-f74e2ce1e39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:41.869048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbf81d-9195-4b42-b312-8249f715dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:41.870851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbf81d-9195-4b42-b312-8249f715dfbc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:41.871279 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbf81d-9195-4b42-b312-8249f715dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:41.871679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbf81d-9195-4b42-b312-8249f715dfbc None admin] PATH_INFO: `/v3/users/8556ff7ce3fc415290dc56e1f7145ebd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:41.874398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbf81d-9195-4b42-b312-8249f715dfbc None admin] RBAC: Authorizing `identity:get_user(user_id=8556ff7ce3fc415290dc56e1f7145ebd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:41.876020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbf81d-9195-4b42-b312-8249f715dfbc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:41.877808 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 75/153] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:41 2022] GET /identity/v3/users/8556ff7ce3fc415290dc56e1f7145ebd => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:41.879402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbf81d-9195-4b42-b312-8249f715dfbc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:41.913111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 79/154] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:41.917011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a347c17-3c52-4db2-ac7d-f74e2ce1e39f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:41.969013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:42.004088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:42.014200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbf81d-9195-4b42-b312-8249f715dfbc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:42.045917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a347c17-3c52-4db2-ac7d-f74e2ce1e39f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:42.056456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f2c97-7475-432c-a9a4-9b799b51855e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:42.057811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f2c97-7475-432c-a9a4-9b799b51855e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:42.058276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f2c97-7475-432c-a9a4-9b799b51855e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:42.058748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f2c97-7475-432c-a9a4-9b799b51855e None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:42.060260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f2c97-7475-432c-a9a4-9b799b51855e None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:42.062650 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f2c97-7475-432c-a9a4-9b799b51855e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:42.064782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 76/155] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:41 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:42.066198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be308a-2f23-4dad-9cbc-85db58a29175 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:42.066786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be308a-2f23-4dad-9cbc-85db58a29175 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:42.067260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be308a-2f23-4dad-9cbc-85db58a29175 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:42.068794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 77/156] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:42.070701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be308a-2f23-4dad-9cbc-85db58a29175 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:42.087631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5173683-eb71-4232-b037-399c1d6c5262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:42.088256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173683-eb71-4232-b037-399c1d6c5262 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:42.088541 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173683-eb71-4232-b037-399c1d6c5262 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:42.088831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173683-eb71-4232-b037-399c1d6c5262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:42.168911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5173683-eb71-4232-b037-399c1d6c5262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:42.171305 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5173683-eb71-4232-b037-399c1d6c5262 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:42.206668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be308a-2f23-4dad-9cbc-85db58a29175 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:42.221352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:42.255423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f04f8-64d4-4513-a099-020eacbe3cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:42.256104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f04f8-64d4-4513-a099-020eacbe3cca None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:42.256386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f04f8-64d4-4513-a099-020eacbe3cca None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:42.256659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f04f8-64d4-4513-a099-020eacbe3cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:42.258296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f04f8-64d4-4513-a099-020eacbe3cca None admin] RBAC: Adding query filter params (role.id=924c0aaeca9d4fa6924529f3f93a2f7e, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57, user.id=8556ff7ce3fc415290dc56e1f7145ebd) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:42.258617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f04f8-64d4-4513-a099-020eacbe3cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:42.260072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f04f8-64d4-4513-a099-020eacbe3cca None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:42.267809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 78/157] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:42 2022] GET /identity/v3/role_assignments?user.id=8556ff7ce3fc415290dc56e1f7145ebd&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=924c0aaeca9d4fa6924529f3f93a2f7e => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:42.269264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22a8ed-99d3-4ac5-9aa7-ba0d5d11772a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:42.269552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22a8ed-99d3-4ac5-9aa7-ba0d5d11772a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:42.269827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22a8ed-99d3-4ac5-9aa7-ba0d5d11772a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:42.295809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-df22a8ed-99d3-4ac5-9aa7-ba0d5d11772a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:42.296538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:42.297483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df22a8ed-99d3-4ac5-9aa7-ba0d5d11772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:42.299548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db01c-67e0-4f5b-9b2d-12395d23c835 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:42.300068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db01c-67e0-4f5b-9b2d-12395d23c835 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:42.300549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db01c-67e0-4f5b-9b2d-12395d23c835 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:42.302532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 81/159] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:42.303627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4db01c-67e0-4f5b-9b2d-12395d23c835 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:42.334723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:42.383952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 79/160] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:42.385273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331f850-6940-4943-b3e1-55f3b29c55cd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:42.385560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331f850-6940-4943-b3e1-55f3b29c55cd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:42.385828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331f850-6940-4943-b3e1-55f3b29c55cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:42.424751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4331f850-6940-4943-b3e1-55f3b29c55cd None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:42.425963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4331f850-6940-4943-b3e1-55f3b29c55cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:42.497270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4db01c-67e0-4f5b-9b2d-12395d23c835 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:42.544126 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0980d9-386a-420b-886a-12242245dec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:42.544810 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0980d9-386a-420b-886a-12242245dec3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:42.545086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0980d9-386a-420b-886a-12242245dec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:42.545353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0980d9-386a-420b-886a-12242245dec3 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:42.546591 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0980d9-386a-420b-886a-12242245dec3 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:42.548103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0980d9-386a-420b-886a-12242245dec3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:42.548605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 80/161] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:42.552072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 82/162] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:42 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:42.552072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0980d9-386a-420b-886a-12242245dec3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:42.557854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331f850-6940-4943-b3e1-55f3b29c55cd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:42.569855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:42.667030 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0980d9-386a-420b-886a-12242245dec3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:42.676128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:42.691991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331f850-6940-4943-b3e1-55f3b29c55cd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:42.702735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251316-f88d-4042-8ed8-d2ff3cd5b6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:42.703376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251316-f88d-4042-8ed8-d2ff3cd5b6bc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:42.703666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251316-f88d-4042-8ed8-d2ff3cd5b6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:42.703923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed251316-f88d-4042-8ed8-d2ff3cd5b6bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:42.716101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed251316-f88d-4042-8ed8-d2ff3cd5b6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ed251316-f88d-4042-8ed8-d2ff3cd5b6bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:42.722389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:42.723299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:42.724054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 83/163] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:42.732039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251316-f88d-4042-8ed8-d2ff3cd5b6bc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:42.748598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47942-f61f-4cb6-b770-690d710b5c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:42.749621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47942-f61f-4cb6-b770-690d710b5c6c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:42.750148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47942-f61f-4cb6-b770-690d710b5c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:42.750628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47942-f61f-4cb6-b770-690d710b5c6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:42.751693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e47942-f61f-4cb6-b770-690d710b5c6c None admin] RBAC: Adding query filter params (role.id=e4dc6d4cfce94e67aa327307e8bd4190, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57, user.id=8556ff7ce3fc415290dc56e1f7145ebd) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:42.752322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e47942-f61f-4cb6-b770-690d710b5c6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:42.754043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e47942-f61f-4cb6-b770-690d710b5c6c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:42.761268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 81/164] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:42 2022] GET /identity/v3/role_assignments?user.id=8556ff7ce3fc415290dc56e1f7145ebd&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:42.798874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47942-f61f-4cb6-b770-690d710b5c6c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:42.837048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:42.900551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed251316-f88d-4042-8ed8-d2ff3cd5b6bc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:42.956257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f281806-928c-4f4e-90ca-94e6ea186853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:42.957360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f281806-928c-4f4e-90ca-94e6ea186853 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:42.957834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f281806-928c-4f4e-90ca-94e6ea186853 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:42.958325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f281806-928c-4f4e-90ca-94e6ea186853 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:42.960075 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f281806-928c-4f4e-90ca-94e6ea186853 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:42.961666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f281806-928c-4f4e-90ca-94e6ea186853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:42.963353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f281806-928c-4f4e-90ca-94e6ea186853 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:42.975840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 84/165] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:42.985524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f281806-928c-4f4e-90ca-94e6ea186853 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:43.001144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47942-f61f-4cb6-b770-690d710b5c6c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:43.036576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aafbdc-70ba-4ea5-83a3-865d76196578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:43.037679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aafbdc-70ba-4ea5-83a3-865d76196578 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:43.038181 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aafbdc-70ba-4ea5-83a3-865d76196578 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:43.038783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aafbdc-70ba-4ea5-83a3-865d76196578 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:43.050380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aafbdc-70ba-4ea5-83a3-865d76196578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-93aafbdc-70ba-4ea5-83a3-865d76196578 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:43.056567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:43.057812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:43.058609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:43.062160 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 82/166] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:08:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:43.068336 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aafbdc-70ba-4ea5-83a3-865d76196578 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:43.089063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:43.103687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f281806-928c-4f4e-90ca-94e6ea186853 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:43.151118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:43.162376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b531f2-1685-45ca-b0d6-b7521d6c47a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:43.163022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b531f2-1685-45ca-b0d6-b7521d6c47a4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:43.163300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b531f2-1685-45ca-b0d6-b7521d6c47a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:43.163630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b531f2-1685-45ca-b0d6-b7521d6c47a4 None admin] PATH_INFO: `/v3/users/ebb374c1123a4b1c94213c0f77129cf5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:43.164929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b531f2-1685-45ca-b0d6-b7521d6c47a4 None admin] RBAC: Authorizing `identity:get_user(user_id=ebb374c1123a4b1c94213c0f77129cf5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:43.166533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b531f2-1685-45ca-b0d6-b7521d6c47a4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:43.168116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 85/167] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:42 2022] GET /identity/v3/users/ebb374c1123a4b1c94213c0f77129cf5 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:43.168873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b531f2-1685-45ca-b0d6-b7521d6c47a4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:43.191713 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aafbdc-70ba-4ea5-83a3-865d76196578 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:43.233682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff99feb-73f4-4fcc-a5ba-6bf8abd687e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:43.234692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99feb-73f4-4fcc-a5ba-6bf8abd687e2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:43.235244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99feb-73f4-4fcc-a5ba-6bf8abd687e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:43.235708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff99feb-73f4-4fcc-a5ba-6bf8abd687e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:43.237226 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff99feb-73f4-4fcc-a5ba-6bf8abd687e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:43.237730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff99feb-73f4-4fcc-a5ba-6bf8abd687e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:43.239417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff99feb-73f4-4fcc-a5ba-6bf8abd687e2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:43.251056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 83/168] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:43.252339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff99feb-73f4-4fcc-a5ba-6bf8abd687e2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:43.342363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b531f2-1685-45ca-b0d6-b7521d6c47a4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:43.363484 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:43.389722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff99feb-73f4-4fcc-a5ba-6bf8abd687e2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:43.420360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ddf63-fc4f-4cf3-a041-2a509c053daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:43.421001 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ddf63-fc4f-4cf3-a041-2a509c053daf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:43.421332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ddf63-fc4f-4cf3-a041-2a509c053daf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:43.421603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1ddf63-fc4f-4cf3-a041-2a509c053daf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:43.434828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24788d36-b0f9-4289-a871-5c356e59e923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:43.436046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24788d36-b0f9-4289-a871-5c356e59e923 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:43.437636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24788d36-b0f9-4289-a871-5c356e59e923 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:43.438197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24788d36-b0f9-4289-a871-5c356e59e923 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:43.442631 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24788d36-b0f9-4289-a871-5c356e59e923 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:43.444351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24788d36-b0f9-4289-a871-5c356e59e923 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:43.445353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1ddf63-fc4f-4cf3-a041-2a509c053daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:43.450210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 84/169] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:43 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:43.451749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24788d36-b0f9-4289-a871-5c356e59e923 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8d1ddf63-fc4f-4cf3-a041-2a509c053daf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:43.454493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:43.455326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:43.456076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:43.460859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 86/170] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:43.462655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ddf63-fc4f-4cf3-a041-2a509c053daf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:43.536784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:43.585617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1ddf63-fc4f-4cf3-a041-2a509c053daf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:43.621892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e598fa7-07c8-4ca3-a377-efa83d30fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:43.623492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e598fa7-07c8-4ca3-a377-efa83d30fc10 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:43.623966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e598fa7-07c8-4ca3-a377-efa83d30fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:43.624448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e598fa7-07c8-4ca3-a377-efa83d30fc10 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/users/ebb374c1123a4b1c94213c0f77129cf5/roles/2263be67ab644cd1bc02a99e16e1b369` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:43.626617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e598fa7-07c8-4ca3-a377-efa83d30fc10 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4b53680965d437990ee6e4f6a6dbc57, user_id=ebb374c1123a4b1c94213c0f77129cf5, role_id=2263be67ab644cd1bc02a99e16e1b369)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:43.628356 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e598fa7-07c8-4ca3-a377-efa83d30fc10 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:43.648382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 87/171] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:08:43 2022] PUT /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/users/ebb374c1123a4b1c94213c0f77129cf5/roles/2263be67ab644cd1bc02a99e16e1b369 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:08:43.649221 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e598fa7-07c8-4ca3-a377-efa83d30fc10 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:43.690723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24788d36-b0f9-4289-a871-5c356e59e923 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:43.773788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a4007-ecc6-4e16-af1b-d7a6a82efc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:43.775048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a4007-ecc6-4e16-af1b-d7a6a82efc0c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:43.775553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a4007-ecc6-4e16-af1b-d7a6a82efc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:43.776021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a4007-ecc6-4e16-af1b-d7a6a82efc0c None admin] PATH_INFO: `/v3/users/9828bdee3ea64cec99e58fcb117e4cdd` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:43.778445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a4007-ecc6-4e16-af1b-d7a6a82efc0c None admin] RBAC: Authorizing `identity:get_user(user_id=9828bdee3ea64cec99e58fcb117e4cdd)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:43.780219 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a4007-ecc6-4e16-af1b-d7a6a82efc0c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:43.783897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 85/172] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:43 2022] GET /identity/v3/users/9828bdee3ea64cec99e58fcb117e4cdd => generated 247 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:43.795332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a4007-ecc6-4e16-af1b-d7a6a82efc0c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:43.836588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:43.883992 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e598fa7-07c8-4ca3-a377-efa83d30fc10 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:43.914648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:43.951979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e926c-db82-4c51-86da-2702e5266b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:43.952593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e926c-db82-4c51-86da-2702e5266b53 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:43.952875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e926c-db82-4c51-86da-2702e5266b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:43.953148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e926c-db82-4c51-86da-2702e5266b53 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:43.953822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e926c-db82-4c51-86da-2702e5266b53 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:43.954151 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e926c-db82-4c51-86da-2702e5266b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:43.955528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e926c-db82-4c51-86da-2702e5266b53 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:43.970798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 88/173] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:43.987661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e926c-db82-4c51-86da-2702e5266b53 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:44.006350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a4007-ecc6-4e16-af1b-d7a6a82efc0c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:44.071742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8791238-24f9-403e-99c9-e153f7b7f4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:44.072375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8791238-24f9-403e-99c9-e153f7b7f4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:44.072601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8791238-24f9-403e-99c9-e153f7b7f4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:44.072818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8791238-24f9-403e-99c9-e153f7b7f4c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:44.119472 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e926c-db82-4c51-86da-2702e5266b53 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:44.156677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8e8f6-c6a6-4b9b-a6eb-41457a8dc1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:44.157728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8e8f6-c6a6-4b9b-a6eb-41457a8dc1bb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:44.158296 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8e8f6-c6a6-4b9b-a6eb-41457a8dc1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:44.158772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8e8f6-c6a6-4b9b-a6eb-41457a8dc1bb None admin] PATH_INFO: `/v3/users/8556ff7ce3fc415290dc56e1f7145ebd` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:44.160133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8e8f6-c6a6-4b9b-a6eb-41457a8dc1bb None admin] RBAC: Authorizing `identity:get_user(user_id=8556ff7ce3fc415290dc56e1f7145ebd)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:44.162011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8e8f6-c6a6-4b9b-a6eb-41457a8dc1bb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:44.164407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 89/174] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:43 2022] GET /identity/v3/users/8556ff7ce3fc415290dc56e1f7145ebd => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:44.174974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8e8f6-c6a6-4b9b-a6eb-41457a8dc1bb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:44.179713 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8791238-24f9-403e-99c9-e153f7b7f4c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:44.181197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8791238-24f9-403e-99c9-e153f7b7f4c4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:44.196270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:44.251248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:44.289876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 86/175] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:44.303074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8791238-24f9-403e-99c9-e153f7b7f4c4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:44.306945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8e8f6-c6a6-4b9b-a6eb-41457a8dc1bb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:44.342599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af79c95-7da7-4de9-9efc-a9899229e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:44.343869 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af79c95-7da7-4de9-9efc-a9899229e789 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:44.344317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af79c95-7da7-4de9-9efc-a9899229e789 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:44.344738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af79c95-7da7-4de9-9efc-a9899229e789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:44.436020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af79c95-7da7-4de9-9efc-a9899229e789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:44.437736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af79c95-7da7-4de9-9efc-a9899229e789 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:44.518738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8791238-24f9-403e-99c9-e153f7b7f4c4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:44.536344 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:44.545568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:44.569442 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16881ed4-4319-4f07-b771-a1e3f32d7176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:44.570187 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16881ed4-4319-4f07-b771-a1e3f32d7176 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:44.570480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16881ed4-4319-4f07-b771-a1e3f32d7176 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:44.570904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16881ed4-4319-4f07-b771-a1e3f32d7176 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:44.575019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16881ed4-4319-4f07-b771-a1e3f32d7176 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:44.576811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16881ed4-4319-4f07-b771-a1e3f32d7176 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:44.580200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 87/176] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:44 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:44.585372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16881ed4-4319-4f07-b771-a1e3f32d7176 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:44.696530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 90/177] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:44.702334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af79c95-7da7-4de9-9efc-a9899229e789 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:44.788225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16881ed4-4319-4f07-b771-a1e3f32d7176 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:44.852165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecd5ff-4273-4106-8e80-f853171c162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:44.852779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd5ff-4273-4106-8e80-f853171c162a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:44.853060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd5ff-4273-4106-8e80-f853171c162a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:44.853333 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecd5ff-4273-4106-8e80-f853171c162a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:44.854091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecd5ff-4273-4106-8e80-f853171c162a None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57, user.id=9828bdee3ea64cec99e58fcb117e4cdd) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:44.854406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecd5ff-4273-4106-8e80-f853171c162a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:44.856123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecd5ff-4273-4106-8e80-f853171c162a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:44.867919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 88/178] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:44 2022] GET /identity/v3/role_assignments?user.id=9828bdee3ea64cec99e58fcb117e4cdd&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:44.869148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784a365-46ce-46cb-87f4-a2194dc06c60 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:44.869433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784a365-46ce-46cb-87f4-a2194dc06c60 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:44.869706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784a365-46ce-46cb-87f4-a2194dc06c60 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:44.872321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 89/179] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:44.876258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dd107-50e3-449e-bda7-d566408624c6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:44.876542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dd107-50e3-449e-bda7-d566408624c6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:44.876816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dd107-50e3-449e-bda7-d566408624c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:44.909712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af79c95-7da7-4de9-9efc-a9899229e789 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:44.911978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d80dd107-50e3-449e-bda7-d566408624c6 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:44.913166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d80dd107-50e3-449e-bda7-d566408624c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:44.972834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9e24f-3778-4a30-9cef-6ee68d4129f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:44.973400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9e24f-3778-4a30-9cef-6ee68d4129f2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:44.973679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9e24f-3778-4a30-9cef-6ee68d4129f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:44.973949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9e24f-3778-4a30-9cef-6ee68d4129f2 None admin] PATH_INFO: `/v3/projects/28389a16727f43d9bfc0a862bc788460` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:44.975263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9e24f-3778-4a30-9cef-6ee68d4129f2 None admin] RBAC: Authorizing `identity:get_project(project_id=28389a16727f43d9bfc0a862bc788460)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:44.976793 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9e24f-3778-4a30-9cef-6ee68d4129f2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:44.986064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 91/180] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:44 2022] GET /identity/v3/projects/28389a16727f43d9bfc0a862bc788460 => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:44.991240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9e24f-3778-4a30-9cef-6ee68d4129f2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:44.999900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:45.029890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:45.056369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 90/181] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:45.139251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9e24f-3778-4a30-9cef-6ee68d4129f2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:45.190485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b00d3-e2cb-42e7-ad40-60b25729948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:45.191109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b00d3-e2cb-42e7-ad40-60b25729948f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:45.191387 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b00d3-e2cb-42e7-ad40-60b25729948f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:45.191657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b00d3-e2cb-42e7-ad40-60b25729948f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:45.192394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b00d3-e2cb-42e7-ad40-60b25729948f None admin] RBAC: Adding query filter params (role.id=e4dc6d4cfce94e67aa327307e8bd4190, scope.project.id=28389a16727f43d9bfc0a862bc788460, user.id=8556ff7ce3fc415290dc56e1f7145ebd) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:45.192703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b00d3-e2cb-42e7-ad40-60b25729948f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:45.194254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b00d3-e2cb-42e7-ad40-60b25729948f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:45.203546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 92/182] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:44 2022] GET /identity/v3/role_assignments?user.id=8556ff7ce3fc415290dc56e1f7145ebd&scope.project.id=28389a16727f43d9bfc0a862bc788460&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:45.258330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd72d4-8059-4e49-b46d-80b51f964e93 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:45.258845 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd72d4-8059-4e49-b46d-80b51f964e93 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:45.258919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd72d4-8059-4e49-b46d-80b51f964e93 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:45.260488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 91/183] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:45.267443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1eeaa-30fd-47ee-a13e-081eafde9a92 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:45.267772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1eeaa-30fd-47ee-a13e-081eafde9a92 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:45.268009 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1eeaa-30fd-47ee-a13e-081eafde9a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:45.287488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a2f1eeaa-30fd-47ee-a13e-081eafde9a92 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:45.288722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a2f1eeaa-30fd-47ee-a13e-081eafde9a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:45.390686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 93/184] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:45.467312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd72d4-8059-4e49-b46d-80b51f964e93 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:45.597877 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd72d4-8059-4e49-b46d-80b51f964e93 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:45.636682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edf289-d2eb-4c61-bdc4-daf50dbb0767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:45.637715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edf289-d2eb-4c61-bdc4-daf50dbb0767 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:45.638273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edf289-d2eb-4c61-bdc4-daf50dbb0767 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:45.638808 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edf289-d2eb-4c61-bdc4-daf50dbb0767 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:45.649737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edf289-d2eb-4c61-bdc4-daf50dbb0767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:45.653988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbcdec-d2c6-4d3b-b055-01ff1f6e17c4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:45.654311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbcdec-d2c6-4d3b-b055-01ff1f6e17c4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:45.654588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbcdec-d2c6-4d3b-b055-01ff1f6e17c4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-24edf289-d2eb-4c61-bdc4-daf50dbb0767 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:45.655078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:45.655896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:45.656646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:45.657219 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 94/186] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:45.657282 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 92/186] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:08:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:45.663001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edf289-d2eb-4c61-bdc4-daf50dbb0767 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:45.663312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52643826-d0ab-4cbc-a44b-ef043639e66a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:45.663597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52643826-d0ab-4cbc-a44b-ef043639e66a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:45.663943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52643826-d0ab-4cbc-a44b-ef043639e66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:45.690011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-52643826-d0ab-4cbc-a44b-ef043639e66a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:45.691301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-52643826-d0ab-4cbc-a44b-ef043639e66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:45.694641 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:45.709274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:45.771695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 95/187] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:45.772538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52643826-d0ab-4cbc-a44b-ef043639e66a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:45.788633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edf289-d2eb-4c61-bdc4-daf50dbb0767 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:45.837833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61f3b2-66ae-4007-8fbe-0370c613ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:45.839024 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61f3b2-66ae-4007-8fbe-0370c613ea4b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:45.839504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61f3b2-66ae-4007-8fbe-0370c613ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:45.840508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61f3b2-66ae-4007-8fbe-0370c613ea4b None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:45.842278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61f3b2-66ae-4007-8fbe-0370c613ea4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:45.842883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61f3b2-66ae-4007-8fbe-0370c613ea4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:45.845589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61f3b2-66ae-4007-8fbe-0370c613ea4b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:45.857160 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 93/188] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:45.863604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61f3b2-66ae-4007-8fbe-0370c613ea4b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:45.884362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52643826-d0ab-4cbc-a44b-ef043639e66a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:45.930217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5477-c231-4dc2-aec0-f8ea1a044a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:45.931753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5477-c231-4dc2-aec0-f8ea1a044a49 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:45.932041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5477-c231-4dc2-aec0-f8ea1a044a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:45.932320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5477-c231-4dc2-aec0-f8ea1a044a49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:45.943528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:45.947580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b5477-c231-4dc2-aec0-f8ea1a044a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-642b5477-c231-4dc2-aec0-f8ea1a044a49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:45.954020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:45.955149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:45.956178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:45.959037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 96/189] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:08:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:45.964462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5477-c231-4dc2-aec0-f8ea1a044a49 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:45.980062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:45.987332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61f3b2-66ae-4007-8fbe-0370c613ea4b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:46.024185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e363c-8246-417f-9ba5-674ccd48185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:46.024971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e363c-8246-417f-9ba5-674ccd48185d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:46.025351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e363c-8246-417f-9ba5-674ccd48185d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:46.025888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e363c-8246-417f-9ba5-674ccd48185d None admin] PATH_INFO: `/v3/users/03b4b57cdf3b445d87a0903f9e0ed852` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:46.041490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e363c-8246-417f-9ba5-674ccd48185d None admin] RBAC: Authorizing `identity:get_user(user_id=03b4b57cdf3b445d87a0903f9e0ed852)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:46.043332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e363c-8246-417f-9ba5-674ccd48185d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:46.045950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 94/190] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:45 2022] GET /identity/v3/users/03b4b57cdf3b445d87a0903f9e0ed852 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:46.050951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e363c-8246-417f-9ba5-674ccd48185d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:46.077944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5477-c231-4dc2-aec0-f8ea1a044a49 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:46.117729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55405690-779b-4b20-ba35-f759d533887e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:46.118277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55405690-779b-4b20-ba35-f759d533887e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:46.118553 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55405690-779b-4b20-ba35-f759d533887e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:46.119070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55405690-779b-4b20-ba35-f759d533887e None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:46.120295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55405690-779b-4b20-ba35-f759d533887e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:46.120612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55405690-779b-4b20-ba35-f759d533887e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:46.122267 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55405690-779b-4b20-ba35-f759d533887e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:46.137622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 97/191] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:08:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:46.137622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55405690-779b-4b20-ba35-f759d533887e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:46.156314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e363c-8246-417f-9ba5-674ccd48185d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:46.193719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3369ef-c831-412b-a7fd-bdbc3f552dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:46.194387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3369ef-c831-412b-a7fd-bdbc3f552dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:46.194699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3369ef-c831-412b-a7fd-bdbc3f552dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:46.194979 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3369ef-c831-412b-a7fd-bdbc3f552dc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:46.196175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3369ef-c831-412b-a7fd-bdbc3f552dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:46.197624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3369ef-c831-412b-a7fd-bdbc3f552dc7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:46.199255 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 95/192] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:46.200014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3369ef-c831-412b-a7fd-bdbc3f552dc7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:46.206677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:46.226960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:46.250824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55405690-779b-4b20-ba35-f759d533887e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:46.287210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13a53f-171d-420f-a7b3-6ab59f80401b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:46.287914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13a53f-171d-420f-a7b3-6ab59f80401b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:46.288199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13a53f-171d-420f-a7b3-6ab59f80401b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:46.288466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13a53f-171d-420f-a7b3-6ab59f80401b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:46.303214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3369ef-c831-412b-a7fd-bdbc3f552dc7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:46.338983 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5d2df-73d1-4025-9587-eb56bec385c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:46.339784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5d2df-73d1-4025-9587-eb56bec385c3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:46.340063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5d2df-73d1-4025-9587-eb56bec385c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:46.340340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5d2df-73d1-4025-9587-eb56bec385c3 None admin] PATH_INFO: `/v3/users/03b4b57cdf3b445d87a0903f9e0ed852` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:46.341658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5d2df-73d1-4025-9587-eb56bec385c3 None admin] RBAC: Authorizing `identity:get_user(user_id=03b4b57cdf3b445d87a0903f9e0ed852)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:46.344434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5d2df-73d1-4025-9587-eb56bec385c3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:46.346211 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 96/193] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:46 2022] GET /identity/v3/users/03b4b57cdf3b445d87a0903f9e0ed852 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:46.346780 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5d2df-73d1-4025-9587-eb56bec385c3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:46.364705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13a53f-171d-420f-a7b3-6ab59f80401b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:46.366193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13a53f-171d-420f-a7b3-6ab59f80401b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:46.426666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:46.442663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:46.452939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5d2df-73d1-4025-9587-eb56bec385c3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:46.465768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 98/194] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:46.467211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13a53f-171d-420f-a7b3-6ab59f80401b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:46.487057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53092bd9-19c9-4dc9-9677-b631633adad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:46.487661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53092bd9-19c9-4dc9-9677-b631633adad1 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:46.487945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53092bd9-19c9-4dc9-9677-b631633adad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:46.488219 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53092bd9-19c9-4dc9-9677-b631633adad1 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:46.488856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53092bd9-19c9-4dc9-9677-b631633adad1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:46.490325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53092bd9-19c9-4dc9-9677-b631633adad1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:46.510414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 97/195] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:08:46 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:08:46.511722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7814b6-b407-410e-bff0-c308b5e464a0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:46.512013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7814b6-b407-410e-bff0-c308b5e464a0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:46.512324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7814b6-b407-410e-bff0-c308b5e464a0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:46.514058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 98/196] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:46.514772 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7814b6-b407-410e-bff0-c308b5e464a0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:46.590164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13a53f-171d-420f-a7b3-6ab59f80401b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:46.627933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c500fc-32ee-4104-bdbe-0a9c68864c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:46.628556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c500fc-32ee-4104-bdbe-0a9c68864c0c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:46.628833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c500fc-32ee-4104-bdbe-0a9c68864c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:46.629103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c500fc-32ee-4104-bdbe-0a9c68864c0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:46.644544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7814b6-b407-410e-bff0-c308b5e464a0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:46.668175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:46.685291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd5b86-bc4c-4ff6-9a82-cf65cbbe1dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:46.685867 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5b86-bc4c-4ff6-9a82-cf65cbbe1dcf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:46.686242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5b86-bc4c-4ff6-9a82-cf65cbbe1dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:46.686521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd5b86-bc4c-4ff6-9a82-cf65cbbe1dcf None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:46.689056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd5b86-bc4c-4ff6-9a82-cf65cbbe1dcf None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:46.690008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd5b86-bc4c-4ff6-9a82-cf65cbbe1dcf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:46.692234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 99/197] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:46 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:46.697216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bacb7-d2ca-4524-876e-563b19d3fa18 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:46.697216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bacb7-d2ca-4524-876e-563b19d3fa18 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:46.697216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bacb7-d2ca-4524-876e-563b19d3fa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:46.713216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e88bacb7-d2ca-4524-876e-563b19d3fa18 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:46.714100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c500fc-32ee-4104-bdbe-0a9c68864c0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:46.714682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e88bacb7-d2ca-4524-876e-563b19d3fa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:46.715732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c500fc-32ee-4104-bdbe-0a9c68864c0c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:46.725393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:46.804624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 100/198] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:46.805770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bacb7-d2ca-4524-876e-563b19d3fa18 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:46.848942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 99/199] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:46.853859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c500fc-32ee-4104-bdbe-0a9c68864c0c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:46.925232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:46.943002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bacb7-d2ca-4524-876e-563b19d3fa18 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:46.969907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c500fc-32ee-4104-bdbe-0a9c68864c0c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:46.992286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce20e2b-bd78-434a-874c-8a5d93027ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:46.993402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20e2b-bd78-434a-874c-8a5d93027ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:46.993856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20e2b-bd78-434a-874c-8a5d93027ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:46.994589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce20e2b-bd78-434a-874c-8a5d93027ee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:46.995928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce20e2b-bd78-434a-874c-8a5d93027ee0 None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=caad43ce957444119e369cbd62b3b9fe, user.id=03b4b57cdf3b445d87a0903f9e0ed852) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:46.996652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce20e2b-bd78-434a-874c-8a5d93027ee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:46.998963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce20e2b-bd78-434a-874c-8a5d93027ee0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:47.006398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e88c2-0d6a-467c-9fbb-5a44456a956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:47.006637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 101/200] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:46 2022] GET /identity/v3/role_assignments?user.id=03b4b57cdf3b445d87a0903f9e0ed852&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:47.007350 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e88c2-0d6a-467c-9fbb-5a44456a956d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:47.007732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e88c2-0d6a-467c-9fbb-5a44456a956d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:47.008067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e88c2-0d6a-467c-9fbb-5a44456a956d None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:47.009323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e88c2-0d6a-467c-9fbb-5a44456a956d None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:47.011062 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e88c2-0d6a-467c-9fbb-5a44456a956d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:47.013871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 100/201] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:46 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:47.019883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce20e2b-bd78-434a-874c-8a5d93027ee0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:47.032712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:47.105144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e88c2-0d6a-467c-9fbb-5a44456a956d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:47.238096 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e88c2-0d6a-467c-9fbb-5a44456a956d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:47.238580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce20e2b-bd78-434a-874c-8a5d93027ee0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:47.278352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a294-f61c-4a8c-9eb1-a6d811e188ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:47.279021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a294-f61c-4a8c-9eb1-a6d811e188ea None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:47.279806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a294-f61c-4a8c-9eb1-a6d811e188ea None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:47.280077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018a294-f61c-4a8c-9eb1-a6d811e188ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:47.281237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018a294-f61c-4a8c-9eb1-a6d811e188ea None admin] RBAC: Adding query filter params (role.id=924c0aaeca9d4fa6924529f3f93a2f7e, scope.project.id=caad43ce957444119e369cbd62b3b9fe, user.id=03b4b57cdf3b445d87a0903f9e0ed852) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:47.281545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018a294-f61c-4a8c-9eb1-a6d811e188ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:47.283023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018a294-f61c-4a8c-9eb1-a6d811e188ea None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:47.289644 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 102/202] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:47 2022] GET /identity/v3/role_assignments?user.id=03b4b57cdf3b445d87a0903f9e0ed852&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=924c0aaeca9d4fa6924529f3f93a2f7e => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:47.301227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:47.308216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df30efb-7a8a-4b79-b3d7-46f145484c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:47.308871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df30efb-7a8a-4b79-b3d7-46f145484c53 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:47.309154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df30efb-7a8a-4b79-b3d7-46f145484c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:47.309428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df30efb-7a8a-4b79-b3d7-46f145484c53 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:47.323025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df30efb-7a8a-4b79-b3d7-46f145484c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0df30efb-7a8a-4b79-b3d7-46f145484c53 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:47.328875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:47.329718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:47.330565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 101/203] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:08:47.336228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a294-f61c-4a8c-9eb1-a6d811e188ea None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:47.415875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:47.449552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018a294-f61c-4a8c-9eb1-a6d811e188ea None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:47.485352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a97a-46d3-48c3-87cd-36ff6af85524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:47.485971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a97a-46d3-48c3-87cd-36ff6af85524 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:47.486281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a97a-46d3-48c3-87cd-36ff6af85524 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:47.486551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a97a-46d3-48c3-87cd-36ff6af85524 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:47.487218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a97a-46d3-48c3-87cd-36ff6af85524 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:47.487522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a97a-46d3-48c3-87cd-36ff6af85524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:47.488944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a97a-46d3-48c3-87cd-36ff6af85524 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:47.498256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 103/204] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:47.504019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df30efb-7a8a-4b79-b3d7-46f145484c53 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:47.624965 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df30efb-7a8a-4b79-b3d7-46f145484c53 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:47.672144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e7c35-89f0-423e-9fd5-291ebd76ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:47.672829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e7c35-89f0-423e-9fd5-291ebd76ebaa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:47.673120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e7c35-89f0-423e-9fd5-291ebd76ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:47.673394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e7c35-89f0-423e-9fd5-291ebd76ebaa None admin] PATH_INFO: `/v3/users/ebb374c1123a4b1c94213c0f77129cf5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:47.674582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e7c35-89f0-423e-9fd5-291ebd76ebaa None admin] RBAC: Authorizing `identity:get_user(user_id=ebb374c1123a4b1c94213c0f77129cf5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:47.676025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e7c35-89f0-423e-9fd5-291ebd76ebaa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:47.677669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 102/205] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:47 2022] GET /identity/v3/users/ebb374c1123a4b1c94213c0f77129cf5 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:47.683459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a97a-46d3-48c3-87cd-36ff6af85524 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:47.824229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a97a-46d3-48c3-87cd-36ff6af85524 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:47.858934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6c871-3f7d-4029-bba2-98d1e0fb7c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:47.859545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c871-3f7d-4029-bba2-98d1e0fb7c7a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:47.859821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c871-3f7d-4029-bba2-98d1e0fb7c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:47.860090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6c871-3f7d-4029-bba2-98d1e0fb7c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:47.862851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:47.945311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6c871-3f7d-4029-bba2-98d1e0fb7c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:47.946856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6c871-3f7d-4029-bba2-98d1e0fb7c7a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:48.074831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 104/206] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:48.080029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e7c35-89f0-423e-9fd5-291ebd76ebaa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:48.165490 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:48.221449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e7c35-89f0-423e-9fd5-291ebd76ebaa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:48.270710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7faba5-2440-4a21-b11d-b5569b78898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:48.271349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7faba5-2440-4a21-b11d-b5569b78898f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:48.271627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7faba5-2440-4a21-b11d-b5569b78898f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:48.271900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7faba5-2440-4a21-b11d-b5569b78898f None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:48.274767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7faba5-2440-4a21-b11d-b5569b78898f None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:48.276272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7faba5-2440-4a21-b11d-b5569b78898f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:48.277945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 103/207] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:48 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:48.283990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6c871-3f7d-4029-bba2-98d1e0fb7c7a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:48.327087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:48.409397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6c871-3f7d-4029-bba2-98d1e0fb7c7a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:48.454389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd6a02-07a4-4d0b-a3f5-9a182ee790d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:48.455334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd6a02-07a4-4d0b-a3f5-9a182ee790d4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:48.455655 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd6a02-07a4-4d0b-a3f5-9a182ee790d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:48.455926 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd6a02-07a4-4d0b-a3f5-9a182ee790d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:48.456656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd6a02-07a4-4d0b-a3f5-9a182ee790d4 None admin] RBAC: Adding query filter params (role.id=2263be67ab644cd1bc02a99e16e1b369, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57, user.id=ebb374c1123a4b1c94213c0f77129cf5) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:48.456960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd6a02-07a4-4d0b-a3f5-9a182ee790d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:48.458494 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd6a02-07a4-4d0b-a3f5-9a182ee790d4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:48.470923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 105/208] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:48 2022] GET /identity/v3/role_assignments?user.id=ebb374c1123a4b1c94213c0f77129cf5&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=2263be67ab644cd1bc02a99e16e1b369 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:48.789511 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a01dd-f859-4fb3-9d09-4351491ba867 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:48.790071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a01dd-f859-4fb3-9d09-4351491ba867 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:48.790071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a01dd-f859-4fb3-9d09-4351491ba867 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:48.791717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 104/209] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:48.799885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795870df-f87a-436e-b2a8-1f0bc393de1e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:48.800169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795870df-f87a-436e-b2a8-1f0bc393de1e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:48.800439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795870df-f87a-436e-b2a8-1f0bc393de1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:48.820071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-795870df-f87a-436e-b2a8-1f0bc393de1e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:48.821649 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-795870df-f87a-436e-b2a8-1f0bc393de1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:48.900083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 106/210] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:49.173855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a01dd-f859-4fb3-9d09-4351491ba867 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:49.242843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3c2c9-4531-4efa-8227-2e96eec9f832 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:49.243164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3c2c9-4531-4efa-8227-2e96eec9f832 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:49.243394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3c2c9-4531-4efa-8227-2e96eec9f832 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:49.244999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 107/211] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:08:49.249800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade42c-937f-45fe-9244-2f3f50e1e322 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:49.250114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade42c-937f-45fe-9244-2f3f50e1e322 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:49.250387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade42c-937f-45fe-9244-2f3f50e1e322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:49.268403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a0ade42c-937f-45fe-9244-2f3f50e1e322 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:49.269574 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a0ade42c-937f-45fe-9244-2f3f50e1e322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:49.285447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a01dd-f859-4fb3-9d09-4351491ba867 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:49.301092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:49.312692 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:49.322375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0d75a-a764-41e9-b202-d633257c2dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:49.323161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0d75a-a764-41e9-b202-d633257c2dcb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:49.323508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0d75a-a764-41e9-b202-d633257c2dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:49.323847 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0d75a-a764-41e9-b202-d633257c2dcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:49.336719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0d75a-a764-41e9-b202-d633257c2dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-83d0d75a-a764-41e9-b202-d633257c2dcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:49.342186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:49.343065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:49.343845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 105/212] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:49.345781 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3357354-c3ea-49d6-9e62-84d9d6bf4e27 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:49.346985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3357354-c3ea-49d6-9e62-84d9d6bf4e27 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:49.346985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3357354-c3ea-49d6-9e62-84d9d6bf4e27 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:49.350083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 106/213] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:49.352002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3357354-c3ea-49d6-9e62-84d9d6bf4e27 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:49.370152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 108/214] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:49.370152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd742-e1f3-495d-9cfd-80dc89636746 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:49.370152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd742-e1f3-495d-9cfd-80dc89636746 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:49.370152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fd742-e1f3-495d-9cfd-80dc89636746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:49.389697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e82fd742-e1f3-495d-9cfd-80dc89636746 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:49.391186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e82fd742-e1f3-495d-9cfd-80dc89636746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:49.457900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3357354-c3ea-49d6-9e62-84d9d6bf4e27 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:49.476193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 109/215] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:49.497472 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72f57f-7342-4f0a-8634-df4785a42a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:49.498258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72f57f-7342-4f0a-8634-df4785a42a49 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:49.498541 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72f57f-7342-4f0a-8634-df4785a42a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:49.498816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72f57f-7342-4f0a-8634-df4785a42a49 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:49.499549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72f57f-7342-4f0a-8634-df4785a42a49 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:49.499855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72f57f-7342-4f0a-8634-df4785a42a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:49.501292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72f57f-7342-4f0a-8634-df4785a42a49 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:49.510252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 107/216] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:49.516386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fd742-e1f3-495d-9cfd-80dc89636746 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:49.623141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:49.635331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fd742-e1f3-495d-9cfd-80dc89636746 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:49.657747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72f57f-7342-4f0a-8634-df4785a42a49 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:49.673236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d974d3-4162-4d8a-9fd4-acc38dbeca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:49.673876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d974d3-4162-4d8a-9fd4-acc38dbeca46 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:49.674179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d974d3-4162-4d8a-9fd4-acc38dbeca46 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:49.674451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d974d3-4162-4d8a-9fd4-acc38dbeca46 None admin] PATH_INFO: `/v3/users/99ea265c572f47668ed9768425933e35` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:49.690469 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d974d3-4162-4d8a-9fd4-acc38dbeca46 None admin] RBAC: Authorizing `identity:get_user(user_id=99ea265c572f47668ed9768425933e35)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:49.691921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d974d3-4162-4d8a-9fd4-acc38dbeca46 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:49.693838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 110/217] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:49 2022] GET /identity/v3/users/99ea265c572f47668ed9768425933e35 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:49.702960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d974d3-4162-4d8a-9fd4-acc38dbeca46 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:49.721044 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:49.780542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72f57f-7342-4f0a-8634-df4785a42a49 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:49.804819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d974d3-4162-4d8a-9fd4-acc38dbeca46 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:49.818571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f954b66-1be2-470d-91bf-8b62ed749b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:49.819928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f954b66-1be2-470d-91bf-8b62ed749b12 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:49.820527 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f954b66-1be2-470d-91bf-8b62ed749b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:49.821020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f954b66-1be2-470d-91bf-8b62ed749b12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:49.832077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f954b66-1be2-470d-91bf-8b62ed749b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:49.837847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455e687-55bb-4ff3-a144-bc86ab0ccc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:49.838487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455e687-55bb-4ff3-a144-bc86ab0ccc54 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0f954b66-1be2-470d-91bf-8b62ed749b12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:49.838598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:49.839415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:49.840214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:49.842732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455e687-55bb-4ff3-a144-bc86ab0ccc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:49.842732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455e687-55bb-4ff3-a144-bc86ab0ccc54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:49.842933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 108/218] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:08:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:08:49.842933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f954b66-1be2-470d-91bf-8b62ed749b12 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:49.861286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:49.913150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455e687-55bb-4ff3-a144-bc86ab0ccc54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:49.914647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455e687-55bb-4ff3-a144-bc86ab0ccc54 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:49.943754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f954b66-1be2-470d-91bf-8b62ed749b12 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:49.952855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:49.978011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03253b-35bf-4ece-8def-f91d703a69ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:49.978600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03253b-35bf-4ece-8def-f91d703a69ed None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:49.978882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03253b-35bf-4ece-8def-f91d703a69ed None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:49.979152 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03253b-35bf-4ece-8def-f91d703a69ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:49.980496 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03253b-35bf-4ece-8def-f91d703a69ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:49.981934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03253b-35bf-4ece-8def-f91d703a69ed None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:49.983546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 109/219] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:49.984297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03253b-35bf-4ece-8def-f91d703a69ed None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:50.016475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 111/220] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:50.017715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f96f51-5afd-40e0-9e27-5a093fce85a4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:50.018002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f96f51-5afd-40e0-9e27-5a093fce85a4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:50.018307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f96f51-5afd-40e0-9e27-5a093fce85a4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:50.019683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 112/221] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:50.022814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f96f51-5afd-40e0-9e27-5a093fce85a4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:50.068393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:50.081309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03253b-35bf-4ece-8def-f91d703a69ed None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:50.113607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e9657-7acf-4de8-b150-b21656069393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:50.114234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9657-7acf-4de8-b150-b21656069393 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:50.114515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9657-7acf-4de8-b150-b21656069393 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:50.114794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9657-7acf-4de8-b150-b21656069393 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:50.115457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e9657-7acf-4de8-b150-b21656069393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:50.115759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e9657-7acf-4de8-b150-b21656069393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:50.117132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e9657-7acf-4de8-b150-b21656069393 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:50.121685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f96f51-5afd-40e0-9e27-5a093fce85a4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:50.125356 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 110/222] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:50.129665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e9657-7acf-4de8-b150-b21656069393 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:50.155738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753098e-193f-482b-8396-28da4a13b4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:50.156343 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753098e-193f-482b-8396-28da4a13b4be None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:50.156628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753098e-193f-482b-8396-28da4a13b4be None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:50.156905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753098e-193f-482b-8396-28da4a13b4be None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:50.157547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753098e-193f-482b-8396-28da4a13b4be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:50.159015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753098e-193f-482b-8396-28da4a13b4be None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:50.168747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:50.179984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 113/223] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:08:50 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:08:50.195598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898646b-5859-4c61-9800-b42b81d8dce0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:50.195885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898646b-5859-4c61-9800-b42b81d8dce0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:50.196161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898646b-5859-4c61-9800-b42b81d8dce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:50.218771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2898646b-5859-4c61-9800-b42b81d8dce0 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:50.220014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2898646b-5859-4c61-9800-b42b81d8dce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:50.236696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e9657-7acf-4de8-b150-b21656069393 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:50.276962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a1f8a-0299-466d-98c2-a15b94b164d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:50.277607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a1f8a-0299-466d-98c2-a15b94b164d2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:50.277890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a1f8a-0299-466d-98c2-a15b94b164d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:50.278216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a1f8a-0299-466d-98c2-a15b94b164d2 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:50.279976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a1f8a-0299-466d-98c2-a15b94b164d2 None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:50.281456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a1f8a-0299-466d-98c2-a15b94b164d2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:50.283492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 111/224] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:50 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:50.284304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a1f8a-0299-466d-98c2-a15b94b164d2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:50.298674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 114/225] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:50.299917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898646b-5859-4c61-9800-b42b81d8dce0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:50.346787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:50.421405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a1f8a-0299-466d-98c2-a15b94b164d2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:50.432907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:50.444826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898646b-5859-4c61-9800-b42b81d8dce0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:50.467840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d8c8c-81cb-4e4f-b588-42d4e6d90c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:50.468792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d8c8c-81cb-4e4f-b588-42d4e6d90c08 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:50.469246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d8c8c-81cb-4e4f-b588-42d4e6d90c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:50.469848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d8c8c-81cb-4e4f-b588-42d4e6d90c08 None admin] PATH_INFO: `/v3/users/03b4b57cdf3b445d87a0903f9e0ed852` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:50.471476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d8c8c-81cb-4e4f-b588-42d4e6d90c08 None admin] RBAC: Authorizing `identity:get_user(user_id=03b4b57cdf3b445d87a0903f9e0ed852)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:50.473799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d8c8c-81cb-4e4f-b588-42d4e6d90c08 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:50.477161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 112/226] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:50 2022] GET /identity/v3/users/03b4b57cdf3b445d87a0903f9e0ed852 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:50.482825 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d8c8c-81cb-4e4f-b588-42d4e6d90c08 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:50.486114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed46828-77e2-43db-aa1d-df3b331ef2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:50.486869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46828-77e2-43db-aa1d-df3b331ef2bc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:50.487163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46828-77e2-43db-aa1d-df3b331ef2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:50.487507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46828-77e2-43db-aa1d-df3b331ef2bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:50.488324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed46828-77e2-43db-aa1d-df3b331ef2bc None admin] RBAC: Adding query filter params (role.id=e4dc6d4cfce94e67aa327307e8bd4190, scope.project.id=caad43ce957444119e369cbd62b3b9fe, user.id=99ea265c572f47668ed9768425933e35) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:50.488634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed46828-77e2-43db-aa1d-df3b331ef2bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:50.492171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed46828-77e2-43db-aa1d-df3b331ef2bc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:50.501144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 115/227] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:50 2022] GET /identity/v3/role_assignments?user.id=99ea265c572f47668ed9768425933e35&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:50.613332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed46828-77e2-43db-aa1d-df3b331ef2bc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:50.628059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d8c8c-81cb-4e4f-b588-42d4e6d90c08 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:50.676100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022872a-1650-45ea-b75f-86a3222d812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:50.676744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022872a-1650-45ea-b75f-86a3222d812d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:50.677017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022872a-1650-45ea-b75f-86a3222d812d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:50.677286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022872a-1650-45ea-b75f-86a3222d812d None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:50.678472 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022872a-1650-45ea-b75f-86a3222d812d None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:50.680129 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022872a-1650-45ea-b75f-86a3222d812d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:50.681789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 113/228] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:50 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:50.687573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022872a-1650-45ea-b75f-86a3222d812d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:50.738520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:50.795180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022872a-1650-45ea-b75f-86a3222d812d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:50.827676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:50.834703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed46828-77e2-43db-aa1d-df3b331ef2bc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:50.873197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a329ca0-e4a7-4459-bbc3-4d1b7ba4877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:50.873891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a329ca0-e4a7-4459-bbc3-4d1b7ba4877d None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:50.874171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a329ca0-e4a7-4459-bbc3-4d1b7ba4877d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:50.874453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a329ca0-e4a7-4459-bbc3-4d1b7ba4877d None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe/users/03b4b57cdf3b445d87a0903f9e0ed852/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:50.877112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a329ca0-e4a7-4459-bbc3-4d1b7ba4877d None admin] RBAC: Authorizing `identity:create_grant(project_id=caad43ce957444119e369cbd62b3b9fe, user_id=03b4b57cdf3b445d87a0903f9e0ed852, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:50.879677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a329ca0-e4a7-4459-bbc3-4d1b7ba4877d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:50.883710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149ad78-a9a5-4ebf-9c86-8addebe50181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:50.884359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149ad78-a9a5-4ebf-9c86-8addebe50181 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:50.884638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149ad78-a9a5-4ebf-9c86-8addebe50181 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:50.884911 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149ad78-a9a5-4ebf-9c86-8addebe50181 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:50.898744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149ad78-a9a5-4ebf-9c86-8addebe50181 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:50.908620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 114/229] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:08:50 2022] PUT /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe/users/03b4b57cdf3b445d87a0903f9e0ed852/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5149ad78-a9a5-4ebf-9c86-8addebe50181 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:50.911430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:50.912294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:50.913088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 116/230] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:08:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:08:50.918851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a329ca0-e4a7-4459-bbc3-4d1b7ba4877d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:51.065250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a329ca0-e4a7-4459-bbc3-4d1b7ba4877d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:51.066980 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:51.120011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8c071-0921-485d-bd7f-c70f7a5cce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:51.120630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8c071-0921-485d-bd7f-c70f7a5cce64 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:51.120909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8c071-0921-485d-bd7f-c70f7a5cce64 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:51.121174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8c071-0921-485d-bd7f-c70f7a5cce64 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:51.121851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8c071-0921-485d-bd7f-c70f7a5cce64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:51.122179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8c071-0921-485d-bd7f-c70f7a5cce64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:51.124105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8c071-0921-485d-bd7f-c70f7a5cce64 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:51.137871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 115/231] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:08:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:51.144441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149ad78-a9a5-4ebf-9c86-8addebe50181 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:51.258598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149ad78-a9a5-4ebf-9c86-8addebe50181 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:51.292967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3f79d-b03f-407e-997f-b9384dc08115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:51.293601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f79d-b03f-407e-997f-b9384dc08115 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:51.293925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f79d-b03f-407e-997f-b9384dc08115 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:51.294228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f79d-b03f-407e-997f-b9384dc08115 None admin] PATH_INFO: `/v3/users/03b4b57cdf3b445d87a0903f9e0ed852` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:51.295445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3f79d-b03f-407e-997f-b9384dc08115 None admin] RBAC: Authorizing `identity:get_user(user_id=03b4b57cdf3b445d87a0903f9e0ed852)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:51.296883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3f79d-b03f-407e-997f-b9384dc08115 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:51.298640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 117/232] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:51 2022] GET /identity/v3/users/03b4b57cdf3b445d87a0903f9e0ed852 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:51.304055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8c071-0921-485d-bd7f-c70f7a5cce64 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:51.422555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8c071-0921-485d-bd7f-c70f7a5cce64 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:51.465217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3fdbc-758c-4d24-b3e4-55c1e37b5c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:51.465853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3fdbc-758c-4d24-b3e4-55c1e37b5c11 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:51.466161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3fdbc-758c-4d24-b3e4-55c1e37b5c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:51.466988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3fdbc-758c-4d24-b3e4-55c1e37b5c11 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:51.468116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3fdbc-758c-4d24-b3e4-55c1e37b5c11 None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:51.469620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3fdbc-758c-4d24-b3e4-55c1e37b5c11 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:51.471273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 116/233] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:51 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:51.476971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3f79d-b03f-407e-997f-b9384dc08115 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:51.506707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:51.601825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3f79d-b03f-407e-997f-b9384dc08115 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:51.650549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e2589-e52e-4069-b6ed-c7350504658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:51.651465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e2589-e52e-4069-b6ed-c7350504658d None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:51.651916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e2589-e52e-4069-b6ed-c7350504658d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:51.652350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e2589-e52e-4069-b6ed-c7350504658d None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe/users/03b4b57cdf3b445d87a0903f9e0ed852/roles/924c0aaeca9d4fa6924529f3f93a2f7e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:51.656327 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e2589-e52e-4069-b6ed-c7350504658d None admin] RBAC: Authorizing `identity:create_grant(project_id=caad43ce957444119e369cbd62b3b9fe, user_id=03b4b57cdf3b445d87a0903f9e0ed852, role_id=924c0aaeca9d4fa6924529f3f93a2f7e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:51.657818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e2589-e52e-4069-b6ed-c7350504658d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:51.684319 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 118/234] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:08:51 2022] PUT /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe/users/03b4b57cdf3b445d87a0903f9e0ed852/roles/924c0aaeca9d4fa6924529f3f93a2f7e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:08:52.620700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebfed1-a418-48d5-a538-61357cb3af0f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:52.621208 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebfed1-a418-48d5-a538-61357cb3af0f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:52.621280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebfed1-a418-48d5-a538-61357cb3af0f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:52.622911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 117/235] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:52.630456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbfb69-41e3-4e11-aa5f-8da795c0fffc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:52.630925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbfb69-41e3-4e11-aa5f-8da795c0fffc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:52.631000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbfb69-41e3-4e11-aa5f-8da795c0fffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:52.657189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0ffbfb69-41e3-4e11-aa5f-8da795c0fffc None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:52.658436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0ffbfb69-41e3-4e11-aa5f-8da795c0fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:52.732987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735bb14-ee14-47f3-8dca-643ba55eeb12 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:52.733336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735bb14-ee14-47f3-8dca-643ba55eeb12 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:52.733541 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735bb14-ee14-47f3-8dca-643ba55eeb12 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:52.735035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 118/236] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:52.747076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944272a-2b02-44dc-af12-4c0856805941 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:52.748117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944272a-2b02-44dc-af12-4c0856805941 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:52.748592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944272a-2b02-44dc-af12-4c0856805941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:52.748710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 119/237] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:52.783006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a944272a-2b02-44dc-af12-4c0856805941 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:52.784512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a944272a-2b02-44dc-af12-4c0856805941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:52.819577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:52.870865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff429-3392-4fb8-a4f5-904352fc7c0a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:52.871351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff429-3392-4fb8-a4f5-904352fc7c0a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:52.871547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff429-3392-4fb8-a4f5-904352fc7c0a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:52.873527 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 120/238] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:08:52.877397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 119/239] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:52.893423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eafa7c-c903-42e8-b535-e964bdecdb53 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:52.893705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eafa7c-c903-42e8-b535-e964bdecdb53 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:52.893979 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eafa7c-c903-42e8-b535-e964bdecdb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:52.916710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-15eafa7c-c903-42e8-b535-e964bdecdb53 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:52.917877 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-15eafa7c-c903-42e8-b535-e964bdecdb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:52.928078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:52.991931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 121/240] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:53.097872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944272a-2b02-44dc-af12-4c0856805941 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:53.201529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eafa7c-c903-42e8-b535-e964bdecdb53 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:53.229120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944272a-2b02-44dc-af12-4c0856805941 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:53.273646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96cbfc-1b42-4878-a36a-f30850f34a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:53.274738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96cbfc-1b42-4878-a36a-f30850f34a5d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:53.274738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96cbfc-1b42-4878-a36a-f30850f34a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:53.275014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96cbfc-1b42-4878-a36a-f30850f34a5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:53.278269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96cbfc-1b42-4878-a36a-f30850f34a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:53.279875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96cbfc-1b42-4878-a36a-f30850f34a5d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:53.281447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 120/241] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:53.286831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96cbfc-1b42-4878-a36a-f30850f34a5d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:53.333882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eafa7c-c903-42e8-b535-e964bdecdb53 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:53.336550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:53.378892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830eb0d-aeb6-4c61-847a-fec40160fdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:53.379449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830eb0d-aeb6-4c61-847a-fec40160fdfd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:53.379727 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830eb0d-aeb6-4c61-847a-fec40160fdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:53.380002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830eb0d-aeb6-4c61-847a-fec40160fdfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:53.390683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830eb0d-aeb6-4c61-847a-fec40160fdfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a830eb0d-aeb6-4c61-847a-fec40160fdfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:53.395511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:53.396544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 122/242] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:53.397465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830eb0d-aeb6-4c61-847a-fec40160fdfd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:53.399822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96cbfc-1b42-4878-a36a-f30850f34a5d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:53.431306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:53.435553 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402b96c-bf4e-4bbc-a3b3-b242f3f7ae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:53.436161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402b96c-bf4e-4bbc-a3b3-b242f3f7ae86 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:53.436442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402b96c-bf4e-4bbc-a3b3-b242f3f7ae86 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:53.436715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402b96c-bf4e-4bbc-a3b3-b242f3f7ae86 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:53.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402b96c-bf4e-4bbc-a3b3-b242f3f7ae86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:53.438876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402b96c-bf4e-4bbc-a3b3-b242f3f7ae86 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:53.467439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 121/243] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:08:53 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:08:53.468583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402b96c-bf4e-4bbc-a3b3-b242f3f7ae86 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:53.520039 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830eb0d-aeb6-4c61-847a-fec40160fdfd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:53.584266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe94a-8126-4557-969c-fd67921874e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:53.585161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe94a-8126-4557-969c-fd67921874e6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:53.586366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe94a-8126-4557-969c-fd67921874e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:53.586648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe94a-8126-4557-969c-fd67921874e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:53.613309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fe94a-8126-4557-969c-fd67921874e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ef9fe94a-8126-4557-969c-fd67921874e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:53.622225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:53.624427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:53.626414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 123/244] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:53.632405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:53.634079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe94a-8126-4557-969c-fd67921874e6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:53.672015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402b96c-bf4e-4bbc-a3b3-b242f3f7ae86 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:53.713799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041e5cd-00d9-4d1e-a6d4-c5068c3fe568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:53.714466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e5cd-00d9-4d1e-a6d4-c5068c3fe568 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:53.714748 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e5cd-00d9-4d1e-a6d4-c5068c3fe568 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:53.715021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e5cd-00d9-4d1e-a6d4-c5068c3fe568 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:53.716057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041e5cd-00d9-4d1e-a6d4-c5068c3fe568 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:53.717016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041e5cd-00d9-4d1e-a6d4-c5068c3fe568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:53.718679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041e5cd-00d9-4d1e-a6d4-c5068c3fe568 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:53.725232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:53.730676 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 122/245] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:53.736074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041e5cd-00d9-4d1e-a6d4-c5068c3fe568 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:53.778755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe94a-8126-4557-969c-fd67921874e6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:53.824064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fa078-4804-487d-ac66-48fc8a309439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:53.824854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fa078-4804-487d-ac66-48fc8a309439 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:53.825135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fa078-4804-487d-ac66-48fc8a309439 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:53.825442 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fa078-4804-487d-ac66-48fc8a309439 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:53.826715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fa078-4804-487d-ac66-48fc8a309439 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:53.827018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fa078-4804-487d-ac66-48fc8a309439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:53.828418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fa078-4804-487d-ac66-48fc8a309439 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:53.838624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 124/246] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:53.839884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9774cf-cc9c-4e8d-9a73-09184c7f9313 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:53.840169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9774cf-cc9c-4e8d-9a73-09184c7f9313 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:53.840444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9774cf-cc9c-4e8d-9a73-09184c7f9313 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:53.842787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 125/247] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:53.849107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3f7d7-598c-4de8-9362-a8cfac89804f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:53.849395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3f7d7-598c-4de8-9362-a8cfac89804f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:53.849697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3f7d7-598c-4de8-9362-a8cfac89804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:53.864588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041e5cd-00d9-4d1e-a6d4-c5068c3fe568 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:53.874110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-adc3f7d7-598c-4de8-9362-a8cfac89804f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:53.875317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-adc3f7d7-598c-4de8-9362-a8cfac89804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:53.904461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5b95c-044d-4ff6-afc0-7541f1fa3e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:53.905127 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b95c-044d-4ff6-afc0-7541f1fa3e21 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:53.905487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b95c-044d-4ff6-afc0-7541f1fa3e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:53.905759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b95c-044d-4ff6-afc0-7541f1fa3e21 None admin] PATH_INFO: `/v3/users/99ea265c572f47668ed9768425933e35` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:53.906954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5b95c-044d-4ff6-afc0-7541f1fa3e21 None admin] RBAC: Authorizing `identity:get_user(user_id=99ea265c572f47668ed9768425933e35)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:53.908393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5b95c-044d-4ff6-afc0-7541f1fa3e21 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:53.910160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 123/248] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:53 2022] GET /identity/v3/users/99ea265c572f47668ed9768425933e35 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:53.914824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5b95c-044d-4ff6-afc0-7541f1fa3e21 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:53.939229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:53.961451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 126/249] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:53.962840 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3f7d7-598c-4de8-9362-a8cfac89804f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:54.025097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:54.053115 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5b95c-044d-4ff6-afc0-7541f1fa3e21 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:54.073020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3f7d7-598c-4de8-9362-a8cfac89804f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:54.111313 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee49e5-6db2-4b92-b4a8-a80989253f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:54.111924 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee49e5-6db2-4b92-b4a8-a80989253f6f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:54.112217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee49e5-6db2-4b92-b4a8-a80989253f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:54.112466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee49e5-6db2-4b92-b4a8-a80989253f6f None admin] PATH_INFO: `/v3/users/22f75191120f427187cac18928d6a728` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:54.114362 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5569d6-9d30-4360-bed0-38c9ae752ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:54.115256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5569d6-9d30-4360-bed0-38c9ae752ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:54.115725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5569d6-9d30-4360-bed0-38c9ae752ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:54.116189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5569d6-9d30-4360-bed0-38c9ae752ba8 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:54.117496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5569d6-9d30-4360-bed0-38c9ae752ba8 None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:54.120106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5569d6-9d30-4360-bed0-38c9ae752ba8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:54.122118 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 127/250] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:53 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:54.131264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5569d6-9d30-4360-bed0-38c9ae752ba8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:54.136176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee49e5-6db2-4b92-b4a8-a80989253f6f None admin] RBAC: Authorizing `identity:get_user(user_id=22f75191120f427187cac18928d6a728)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:54.136176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee49e5-6db2-4b92-b4a8-a80989253f6f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:54.142052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 124/251] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:53 2022] GET /identity/v3/users/22f75191120f427187cac18928d6a728 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:54.147014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee49e5-6db2-4b92-b4a8-a80989253f6f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:54.241438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5569d6-9d30-4360-bed0-38c9ae752ba8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:54.256754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:54.274433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:54.283262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ec20e-e668-4021-a556-61d6531d7bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:54.284219 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec20e-e668-4021-a556-61d6531d7bec None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:54.286461 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec20e-e668-4021-a556-61d6531d7bec None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:54.286935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ec20e-e668-4021-a556-61d6531d7bec None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe/users/99ea265c572f47668ed9768425933e35/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:54.290709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ec20e-e668-4021-a556-61d6531d7bec None admin] RBAC: Authorizing `identity:create_grant(project_id=caad43ce957444119e369cbd62b3b9fe, user_id=99ea265c572f47668ed9768425933e35, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:54.292524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ec20e-e668-4021-a556-61d6531d7bec None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:54.311947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee49e5-6db2-4b92-b4a8-a80989253f6f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:54.315685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 128/252] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:08:54 2022] PUT /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe/users/99ea265c572f47668ed9768425933e35/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:08:54.319383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea098a7-efc4-4a50-8037-f5878abcd1fa None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:54.319952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea098a7-efc4-4a50-8037-f5878abcd1fa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:54.320467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea098a7-efc4-4a50-8037-f5878abcd1fa None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:54.322652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 129/253] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:54.328564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea098a7-efc4-4a50-8037-f5878abcd1fa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:54.390099 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07534d55-6038-4481-b9c7-42d1d56fee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:54.391115 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07534d55-6038-4481-b9c7-42d1d56fee26 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:54.391590 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07534d55-6038-4481-b9c7-42d1d56fee26 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:54.392084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07534d55-6038-4481-b9c7-42d1d56fee26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:54.525895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07534d55-6038-4481-b9c7-42d1d56fee26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:54.527511 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07534d55-6038-4481-b9c7-42d1d56fee26 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:54.527707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea098a7-efc4-4a50-8037-f5878abcd1fa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:54.574896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89203ba1-6b29-4bde-a6fb-89ef34b530e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:54.575543 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89203ba1-6b29-4bde-a6fb-89ef34b530e8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:54.576304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89203ba1-6b29-4bde-a6fb-89ef34b530e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:54.576598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89203ba1-6b29-4bde-a6fb-89ef34b530e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:54.590823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89203ba1-6b29-4bde-a6fb-89ef34b530e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-89203ba1-6b29-4bde-a6fb-89ef34b530e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:54.597426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:54.598318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:08:54.599106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:54.602126 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 130/254] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:08:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:54.603379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7fde7-dde4-4824-9e35-a25b1bf61d99 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:54.603663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7fde7-dde4-4824-9e35-a25b1bf61d99 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:54.603932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7fde7-dde4-4824-9e35-a25b1bf61d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:54.620207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:54.631427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-69d7fde7-dde4-4824-9e35-a25b1bf61d99 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:54.633291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-69d7fde7-dde4-4824-9e35-a25b1bf61d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:54.649458 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 125/255] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:54.650331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07534d55-6038-4481-b9c7-42d1d56fee26 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:54.693044 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:54.729852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 131/256] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:54.732485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7fde7-dde4-4824-9e35-a25b1bf61d99 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:54.767525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07534d55-6038-4481-b9c7-42d1d56fee26 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:54.804514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d12e9f-88ca-476e-84f9-88478ffb3eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:54.805041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12e9f-88ca-476e-84f9-88478ffb3eaf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:54.805318 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12e9f-88ca-476e-84f9-88478ffb3eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:54.805586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12e9f-88ca-476e-84f9-88478ffb3eaf None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:54.806417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d12e9f-88ca-476e-84f9-88478ffb3eaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:54.806597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d12e9f-88ca-476e-84f9-88478ffb3eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:54.808030 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d12e9f-88ca-476e-84f9-88478ffb3eaf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:54.821710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 126/257] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:54.827769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d12e9f-88ca-476e-84f9-88478ffb3eaf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:54.871532 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7fde7-dde4-4824-9e35-a25b1bf61d99 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:54.899885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:54.915448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3d08b-3155-481e-9dc9-084831f1bbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:54.916450 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d08b-3155-481e-9dc9-084831f1bbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:54.916934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d08b-3155-481e-9dc9-084831f1bbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:54.917411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d08b-3155-481e-9dc9-084831f1bbd7 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:54.918955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3d08b-3155-481e-9dc9-084831f1bbd7 None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:54.921241 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3d08b-3155-481e-9dc9-084831f1bbd7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:54.924372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 132/258] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:54 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:54.930580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3d08b-3155-481e-9dc9-084831f1bbd7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:54.987659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:55.048628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d12e9f-88ca-476e-84f9-88478ffb3eaf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:55.053624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3d08b-3155-481e-9dc9-084831f1bbd7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:55.101539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce15bf-844e-416c-9c72-844c08934663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:55.102513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce15bf-844e-416c-9c72-844c08934663 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:55.102999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce15bf-844e-416c-9c72-844c08934663 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:55.103470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce15bf-844e-416c-9c72-844c08934663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:55.104396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce15bf-844e-416c-9c72-844c08934663 None admin] RBAC: Adding query filter params (role.id=2263be67ab644cd1bc02a99e16e1b369, scope.project.id=caad43ce957444119e369cbd62b3b9fe, user.id=22f75191120f427187cac18928d6a728) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:55.105185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce15bf-844e-416c-9c72-844c08934663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:55.107856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce15bf-844e-416c-9c72-844c08934663 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:55.115003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 133/259] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:54 2022] GET /identity/v3/role_assignments?user.id=22f75191120f427187cac18928d6a728&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=2263be67ab644cd1bc02a99e16e1b369 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:55.116256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce15bf-844e-416c-9c72-844c08934663 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:55.132054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04b14b-aff9-4ed4-8900-a64886561964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:55.132745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04b14b-aff9-4ed4-8900-a64886561964 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:55.133011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04b14b-aff9-4ed4-8900-a64886561964 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:55.133294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04b14b-aff9-4ed4-8900-a64886561964 None admin] PATH_INFO: `/v3/users/03b4b57cdf3b445d87a0903f9e0ed852` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:55.136080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04b14b-aff9-4ed4-8900-a64886561964 None admin] RBAC: Authorizing `identity:get_user(user_id=03b4b57cdf3b445d87a0903f9e0ed852)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:55.137737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04b14b-aff9-4ed4-8900-a64886561964 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:55.139671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 127/260] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:54 2022] GET /identity/v3/users/03b4b57cdf3b445d87a0903f9e0ed852 => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:55.147154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04b14b-aff9-4ed4-8900-a64886561964 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:55.334769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce15bf-844e-416c-9c72-844c08934663 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:55.343998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:55.373948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156b981-1a96-459d-bd98-f43539469b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:55.375234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156b981-1a96-459d-bd98-f43539469b08 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:55.375859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156b981-1a96-459d-bd98-f43539469b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:55.376333 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156b981-1a96-459d-bd98-f43539469b08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:55.388611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156b981-1a96-459d-bd98-f43539469b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5156b981-1a96-459d-bd98-f43539469b08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:55.393887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:55.394852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:08:55.395630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:55.397939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 134/261] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:08:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:55.399959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04b14b-aff9-4ed4-8900-a64886561964 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:55.405220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:55.406256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156b981-1a96-459d-bd98-f43539469b08 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:55.476995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27565be-16d6-4dbe-8883-ac6908aed271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:55.477609 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27565be-16d6-4dbe-8883-ac6908aed271 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:55.477887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27565be-16d6-4dbe-8883-ac6908aed271 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:55.478191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27565be-16d6-4dbe-8883-ac6908aed271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:55.524923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156b981-1a96-459d-bd98-f43539469b08 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:55.566446 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f742454-a878-4f27-b228-caa027192411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:55.567441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f742454-a878-4f27-b228-caa027192411 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:55.567824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f742454-a878-4f27-b228-caa027192411 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:55.568302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f742454-a878-4f27-b228-caa027192411 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:55.569070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f742454-a878-4f27-b228-caa027192411 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:55.569473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f742454-a878-4f27-b228-caa027192411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:55.570986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f742454-a878-4f27-b228-caa027192411 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:55.581097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 135/262] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:08:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:55.586493 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f742454-a878-4f27-b228-caa027192411 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:55.615945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27565be-16d6-4dbe-8883-ac6908aed271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:55.617590 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27565be-16d6-4dbe-8883-ac6908aed271 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:55.622406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:55.705751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f742454-a878-4f27-b228-caa027192411 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:55.748518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babfe4d-a004-431e-ac53-34d1e1aff580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:55.749312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babfe4d-a004-431e-ac53-34d1e1aff580 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:55.749600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babfe4d-a004-431e-ac53-34d1e1aff580 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:55.749874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babfe4d-a004-431e-ac53-34d1e1aff580 None admin] PATH_INFO: `/v3/users/03b4b57cdf3b445d87a0903f9e0ed852` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:55.751256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babfe4d-a004-431e-ac53-34d1e1aff580 None admin] RBAC: Authorizing `identity:get_user(user_id=03b4b57cdf3b445d87a0903f9e0ed852)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:55.753138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babfe4d-a004-431e-ac53-34d1e1aff580 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:55.755840 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 136/263] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:55 2022] GET /identity/v3/users/03b4b57cdf3b445d87a0903f9e0ed852 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:55.764004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babfe4d-a004-431e-ac53-34d1e1aff580 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:55.873508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:55.873811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 128/264] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 15:08:55.880356 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babfe4d-a004-431e-ac53-34d1e1aff580 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:55.896234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27565be-16d6-4dbe-8883-ac6908aed271 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:55.900292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:55.927275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835b09b-c86f-4797-9508-2c2148f3822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:55.928255 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835b09b-c86f-4797-9508-2c2148f3822d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:55.928534 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835b09b-c86f-4797-9508-2c2148f3822d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:55.928854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835b09b-c86f-4797-9508-2c2148f3822d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:56.008014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835b09b-c86f-4797-9508-2c2148f3822d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:56.009554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835b09b-c86f-4797-9508-2c2148f3822d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:56.100779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27565be-16d6-4dbe-8883-ac6908aed271 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:56.119124 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:56.128556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 137/265] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:56.131778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835b09b-c86f-4797-9508-2c2148f3822d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:56.183691 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aae868-061f-47a3-95f4-139cddd66e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:56.184336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aae868-061f-47a3-95f4-139cddd66e2d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:56.184712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aae868-061f-47a3-95f4-139cddd66e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:56.185601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aae868-061f-47a3-95f4-139cddd66e2d None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:56.190731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aae868-061f-47a3-95f4-139cddd66e2d None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:56.192444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aae868-061f-47a3-95f4-139cddd66e2d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:56.194137 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 129/266] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:55 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:56.220789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aae868-061f-47a3-95f4-139cddd66e2d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:56.251278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835b09b-c86f-4797-9508-2c2148f3822d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:56.287892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a020815-3001-4ecb-b667-06758f6ccbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:56.288506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020815-3001-4ecb-b667-06758f6ccbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:56.288791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020815-3001-4ecb-b667-06758f6ccbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:56.289065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020815-3001-4ecb-b667-06758f6ccbb1 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:56.290231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a020815-3001-4ecb-b667-06758f6ccbb1 None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:56.291973 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a020815-3001-4ecb-b667-06758f6ccbb1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:56.293554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 138/267] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:56 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:56.299304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176fa8-f720-448a-82a6-672bdf0d1181 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:56.299586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176fa8-f720-448a-82a6-672bdf0d1181 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:56.299862 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68176fa8-f720-448a-82a6-672bdf0d1181 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:56.301309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 139/268] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:56.305834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68176fa8-f720-448a-82a6-672bdf0d1181 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:56.309416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:56.340698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aae868-061f-47a3-95f4-139cddd66e2d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:56.374513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:56.377068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49c991-bb34-4542-88a7-a9294073eda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:56.377908 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49c991-bb34-4542-88a7-a9294073eda8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:56.378465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49c991-bb34-4542-88a7-a9294073eda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:56.378935 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49c991-bb34-4542-88a7-a9294073eda8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:56.379864 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49c991-bb34-4542-88a7-a9294073eda8 None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=caad43ce957444119e369cbd62b3b9fe, user.id=03b4b57cdf3b445d87a0903f9e0ed852) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:56.380374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49c991-bb34-4542-88a7-a9294073eda8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:56.382017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49c991-bb34-4542-88a7-a9294073eda8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:56.388373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 130/269] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:56 2022] GET /identity/v3/role_assignments?user.id=03b4b57cdf3b445d87a0903f9e0ed852&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:56.389789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248790a-c237-48b1-8158-8fe1039212bf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:56.390296 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248790a-c237-48b1-8158-8fe1039212bf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:56.390773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248790a-c237-48b1-8158-8fe1039212bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:56.418903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0248790a-c237-48b1-8158-8fe1039212bf None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:56.421177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0248790a-c237-48b1-8158-8fe1039212bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:56.463286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68176fa8-f720-448a-82a6-672bdf0d1181 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:56.495163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 131/270] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:56.539913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1aaf42-4e63-4363-9900-5b76a7bb94d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:56.540875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aaf42-4e63-4363-9900-5b76a7bb94d2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:56.541373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aaf42-4e63-4363-9900-5b76a7bb94d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:56.541844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1aaf42-4e63-4363-9900-5b76a7bb94d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:56.542807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1aaf42-4e63-4363-9900-5b76a7bb94d2 None admin] RBAC: Adding query filter params (role.id=924c0aaeca9d4fa6924529f3f93a2f7e, scope.project.id=caad43ce957444119e369cbd62b3b9fe, user.id=03b4b57cdf3b445d87a0903f9e0ed852) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:56.543334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1aaf42-4e63-4363-9900-5b76a7bb94d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:56.545588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1aaf42-4e63-4363-9900-5b76a7bb94d2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:56.557877 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 140/271] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:56 2022] GET /identity/v3/role_assignments?user.id=03b4b57cdf3b445d87a0903f9e0ed852&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=924c0aaeca9d4fa6924529f3f93a2f7e => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:56.851631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248790a-c237-48b1-8158-8fe1039212bf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:56.923744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:56.941825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67071366-864b-4d21-b3b9-6bdb7c41eb7a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:56.942348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67071366-864b-4d21-b3b9-6bdb7c41eb7a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:56.942453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67071366-864b-4d21-b3b9-6bdb7c41eb7a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:56.943990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 141/272] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:56.949537 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfd130-86d4-4ac9-bfc7-1cd8f46e5360 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:56.949828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfd130-86d4-4ac9-bfc7-1cd8f46e5360 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:56.950127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfd130-86d4-4ac9-bfc7-1cd8f46e5360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:56.973019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248790a-c237-48b1-8158-8fe1039212bf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:56.985729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-06bfd130-86d4-4ac9-bfc7-1cd8f46e5360 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:56.987323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-06bfd130-86d4-4ac9-bfc7-1cd8f46e5360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:57.020431 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960fd40-7ee4-40c4-ae64-9520fdcca7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:57.021082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960fd40-7ee4-40c4-ae64-9520fdcca7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:57.021363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960fd40-7ee4-40c4-ae64-9520fdcca7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:57.021634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960fd40-7ee4-40c4-ae64-9520fdcca7f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:57.043589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960fd40-7ee4-40c4-ae64-9520fdcca7f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2960fd40-7ee4-40c4-ae64-9520fdcca7f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:57.049943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:57.050837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:57.051607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:08:57.052936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 132/273] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:57.058443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960fd40-7ee4-40c4-ae64-9520fdcca7f7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:57.089506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 142/274] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:57.175752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960fd40-7ee4-40c4-ae64-9520fdcca7f7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:57.203292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:57.213275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045170d-599b-4bed-8dae-4fb8997abe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:57.214179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045170d-599b-4bed-8dae-4fb8997abe79 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:57.214637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045170d-599b-4bed-8dae-4fb8997abe79 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:57.215051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045170d-599b-4bed-8dae-4fb8997abe79 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:57.215865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045170d-599b-4bed-8dae-4fb8997abe79 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:57.216352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045170d-599b-4bed-8dae-4fb8997abe79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:57.217867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045170d-599b-4bed-8dae-4fb8997abe79 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:57.227098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 133/275] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:57.238057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfd130-86d4-4ac9-bfc7-1cd8f46e5360 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:57.302545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:57.337569 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfd130-86d4-4ac9-bfc7-1cd8f46e5360 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:57.348110 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa90a9-76a9-4f52-be81-b89811818234 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:57.348687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa90a9-76a9-4f52-be81-b89811818234 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:57.349161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa90a9-76a9-4f52-be81-b89811818234 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:57.351001 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 134/276] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:08:57.360183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51438cca-4281-4e8f-bfc0-6cd1feee0925 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:57.360762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51438cca-4281-4e8f-bfc0-6cd1feee0925 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:57.361287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51438cca-4281-4e8f-bfc0-6cd1feee0925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:57.379862 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-51438cca-4281-4e8f-bfc0-6cd1feee0925 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:57.380040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d2fa9-92f0-46ab-a355-80ecba90f8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:57.380510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d2fa9-92f0-46ab-a355-80ecba90f8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:57.380789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d2fa9-92f0-46ab-a355-80ecba90f8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:57.381060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d2fa9-92f0-46ab-a355-80ecba90f8f2 None admin] PATH_INFO: `/v3/users/49ae17734bf34b82ac8e6595f4f3b263` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:57.382335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-51438cca-4281-4e8f-bfc0-6cd1feee0925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:57.394828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d2fa9-92f0-46ab-a355-80ecba90f8f2 None admin] RBAC: Authorizing `identity:get_user(user_id=49ae17734bf34b82ac8e6595f4f3b263)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:57.396293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d2fa9-92f0-46ab-a355-80ecba90f8f2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:57.398067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 143/277] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:57 2022] GET /identity/v3/users/49ae17734bf34b82ac8e6595f4f3b263 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:57.398688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d2fa9-92f0-46ab-a355-80ecba90f8f2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:57.457918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 135/278] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:08:57.459896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51438cca-4281-4e8f-bfc0-6cd1feee0925 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:57.510564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d2fa9-92f0-46ab-a355-80ecba90f8f2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:57.534223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:57.561771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16168530-fe86-480c-b023-62bad3a06278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:57.562700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16168530-fe86-480c-b023-62bad3a06278 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:57.563628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16168530-fe86-480c-b023-62bad3a06278 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:57.564123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16168530-fe86-480c-b023-62bad3a06278 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:57.565930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16168530-fe86-480c-b023-62bad3a06278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:57.568428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16168530-fe86-480c-b023-62bad3a06278 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:57.570274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 144/279] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:08:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:57.576490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16168530-fe86-480c-b023-62bad3a06278 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:57.595769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51438cca-4281-4e8f-bfc0-6cd1feee0925 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:57.618385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:57.641190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c832c6-fce9-4d45-9694-0e2585356886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:57.642059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c832c6-fce9-4d45-9694-0e2585356886 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:57.642416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c832c6-fce9-4d45-9694-0e2585356886 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:57.642753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c832c6-fce9-4d45-9694-0e2585356886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:57.643837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c832c6-fce9-4d45-9694-0e2585356886 None admin] RBAC: Adding query filter params (role.id=e4dc6d4cfce94e67aa327307e8bd4190, user.id=49ae17734bf34b82ac8e6595f4f3b263, scope.system=all) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:57.644229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c832c6-fce9-4d45-9694-0e2585356886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:57.645786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c832c6-fce9-4d45-9694-0e2585356886 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:57.658118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 136/280] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 19 15:08:57 2022] GET /identity/v3/role_assignments?user.id=49ae17734bf34b82ac8e6595f4f3b263&scope.system=all&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:57.690726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad5ccb-598c-48c9-a020-ef4b2132c038 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:57.691020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad5ccb-598c-48c9-a020-ef4b2132c038 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:57.691274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad5ccb-598c-48c9-a020-ef4b2132c038 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:57.692770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 137/281] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:08:57.698310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b8f8-4f63-46be-ae50-7bf9d11d9d69 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:57.698590 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b8f8-4f63-46be-ae50-7bf9d11d9d69 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:57.698863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b8f8-4f63-46be-ae50-7bf9d11d9d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:57.711909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16168530-fe86-480c-b023-62bad3a06278 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:57.718934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7905b8f8-4f63-46be-ae50-7bf9d11d9d69 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:57.720160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7905b8f8-4f63-46be-ae50-7bf9d11d9d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:57.756313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe158e-d873-475a-b177-25555353498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:57.757102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe158e-d873-475a-b177-25555353498b None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:57.757384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe158e-d873-475a-b177-25555353498b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:57.757660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe158e-d873-475a-b177-25555353498b None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:57.758353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe158e-d873-475a-b177-25555353498b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:57.759850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe158e-d873-475a-b177-25555353498b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:57.784505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 145/282] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:08:57 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:08:57.787585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe158e-d873-475a-b177-25555353498b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:57.813078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 138/283] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:08:57.844556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:57.911455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe158e-d873-475a-b177-25555353498b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:57.947530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c60997-546b-4650-aaa0-e4f7e42cbce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:57.948167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60997-546b-4650-aaa0-e4f7e42cbce2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:57.948440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60997-546b-4650-aaa0-e4f7e42cbce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:57.948718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c60997-546b-4650-aaa0-e4f7e42cbce2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:57.960050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c60997-546b-4650-aaa0-e4f7e42cbce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-26c60997-546b-4650-aaa0-e4f7e42cbce2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:57.965359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:57.966284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:57.967073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 146/284] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:57.973593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905b8f8-4f63-46be-ae50-7bf9d11d9d69 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:58.083414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905b8f8-4f63-46be-ae50-7bf9d11d9d69 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:58.089999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c60997-546b-4650-aaa0-e4f7e42cbce2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:58.104813 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:58.133148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7e89e-beb7-495f-9a9a-a74287591fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:58.134076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7e89e-beb7-495f-9a9a-a74287591fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:58.134532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7e89e-beb7-495f-9a9a-a74287591fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:58.134804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7e89e-beb7-495f-9a9a-a74287591fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:58.135479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7e89e-beb7-495f-9a9a-a74287591fa4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:58.135846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7e89e-beb7-495f-9a9a-a74287591fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:58.137227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7e89e-beb7-495f-9a9a-a74287591fa4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:58.146155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 139/285] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:58.156353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7e89e-beb7-495f-9a9a-a74287591fa4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:58.264857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7e89e-beb7-495f-9a9a-a74287591fa4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:58.272809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:58.276742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c60997-546b-4650-aaa0-e4f7e42cbce2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:58.300035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b165b-08b1-45c3-b2a0-9419683c842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:58.300673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b165b-08b1-45c3-b2a0-9419683c842e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:58.300957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b165b-08b1-45c3-b2a0-9419683c842e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:58.301224 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b165b-08b1-45c3-b2a0-9419683c842e None admin] PATH_INFO: `/v3/users/99ea265c572f47668ed9768425933e35` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:58.302398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b165b-08b1-45c3-b2a0-9419683c842e None admin] RBAC: Authorizing `identity:get_user(user_id=99ea265c572f47668ed9768425933e35)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:58.303913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b165b-08b1-45c3-b2a0-9419683c842e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:58.305694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 140/286] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:58 2022] GET /identity/v3/users/99ea265c572f47668ed9768425933e35 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:08:58.316961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b165b-08b1-45c3-b2a0-9419683c842e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:58.331391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d0e1-e273-4731-ba10-f2ec0b0be405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:58.332384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d0e1-e273-4731-ba10-f2ec0b0be405 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:58.332881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d0e1-e273-4731-ba10-f2ec0b0be405 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:58.333358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35d0e1-e273-4731-ba10-f2ec0b0be405 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:58.352482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35d0e1-e273-4731-ba10-f2ec0b0be405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3c35d0e1-e273-4731-ba10-f2ec0b0be405 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:08:58.359204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:08:58.360067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:08:58.360838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:08:58.368717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 147/287] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:08:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:08:58.372890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d0e1-e273-4731-ba10-f2ec0b0be405 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:58.410399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:58.511922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35d0e1-e273-4731-ba10-f2ec0b0be405 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:58.524895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b165b-08b1-45c3-b2a0-9419683c842e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:58.561486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0474b0-b497-4b42-bd6f-771cbafc84c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:58.562553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0474b0-b497-4b42-bd6f-771cbafc84c0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:58.563065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0474b0-b497-4b42-bd6f-771cbafc84c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:58.563541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0474b0-b497-4b42-bd6f-771cbafc84c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:58.564410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0474b0-b497-4b42-bd6f-771cbafc84c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:58.564923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0474b0-b497-4b42-bd6f-771cbafc84c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:58.566551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0474b0-b497-4b42-bd6f-771cbafc84c0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:58.578157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 148/288] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:08:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:58.584272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0474b0-b497-4b42-bd6f-771cbafc84c0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:58.605682 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d08b26-ce4d-42d0-8599-9e8ec3bfd92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:58.606666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d08b26-ce4d-42d0-8599-9e8ec3bfd92c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:58.607751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d08b26-ce4d-42d0-8599-9e8ec3bfd92c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:58.608259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d08b26-ce4d-42d0-8599-9e8ec3bfd92c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:58.630403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:58.739556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0474b0-b497-4b42-bd6f-771cbafc84c0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:58.748331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d08b26-ce4d-42d0-8599-9e8ec3bfd92c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:58.749800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d08b26-ce4d-42d0-8599-9e8ec3bfd92c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:58.775438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11969f99-3e28-4a3f-bc38-7a277d7af240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:58.776003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11969f99-3e28-4a3f-bc38-7a277d7af240 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:58.776289 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11969f99-3e28-4a3f-bc38-7a277d7af240 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:58.776566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11969f99-3e28-4a3f-bc38-7a277d7af240 None admin] PATH_INFO: `/v3/users/22f75191120f427187cac18928d6a728` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:58.777720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11969f99-3e28-4a3f-bc38-7a277d7af240 None admin] RBAC: Authorizing `identity:get_user(user_id=22f75191120f427187cac18928d6a728)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:58.779251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11969f99-3e28-4a3f-bc38-7a277d7af240 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:58.781131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 149/289] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:08:58 2022] GET /identity/v3/users/22f75191120f427187cac18928d6a728 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:58.795280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11969f99-3e28-4a3f-bc38-7a277d7af240 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:58.814798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:58.922429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:58.926059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 141/290] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:08:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:08:58.928315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11969f99-3e28-4a3f-bc38-7a277d7af240 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:58.940188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d08b26-ce4d-42d0-8599-9e8ec3bfd92c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:58.966730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eca2bf-4528-4bfb-b9cb-0fe3cb17e360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:58.967364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca2bf-4528-4bfb-b9cb-0fe3cb17e360 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:58.967651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca2bf-4528-4bfb-b9cb-0fe3cb17e360 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:58.967920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eca2bf-4528-4bfb-b9cb-0fe3cb17e360 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:58.969053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eca2bf-4528-4bfb-b9cb-0fe3cb17e360 None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:58.970532 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eca2bf-4528-4bfb-b9cb-0fe3cb17e360 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:58.972538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 150/291] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:58 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:58.978324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eca2bf-4528-4bfb-b9cb-0fe3cb17e360 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:59.126052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d08b26-ce4d-42d0-8599-9e8ec3bfd92c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:59.165158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a418d-6373-474e-a902-b979fe2d8da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:59.165827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a418d-6373-474e-a902-b979fe2d8da1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:59.166142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a418d-6373-474e-a902-b979fe2d8da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:59.166425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a418d-6373-474e-a902-b979fe2d8da1 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:59.171442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a418d-6373-474e-a902-b979fe2d8da1 None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:59.172900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a418d-6373-474e-a902-b979fe2d8da1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:59.178519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 142/292] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:08:58 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:59.184788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eca2bf-4528-4bfb-b9cb-0fe3cb17e360 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:59.187015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a418d-6373-474e-a902-b979fe2d8da1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:08:59.206483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:08:59.227174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121eb55-b829-4002-a6ef-1f4e41e5d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:59.227961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121eb55-b829-4002-a6ef-1f4e41e5d855 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:59.228252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121eb55-b829-4002-a6ef-1f4e41e5d855 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:59.228530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121eb55-b829-4002-a6ef-1f4e41e5d855 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe/users/22f75191120f427187cac18928d6a728/roles/2263be67ab644cd1bc02a99e16e1b369` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:59.231054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121eb55-b829-4002-a6ef-1f4e41e5d855 None admin] RBAC: Authorizing `identity:create_grant(project_id=caad43ce957444119e369cbd62b3b9fe, user_id=22f75191120f427187cac18928d6a728, role_id=2263be67ab644cd1bc02a99e16e1b369)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:59.233252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121eb55-b829-4002-a6ef-1f4e41e5d855 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:59.258763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 151/293] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:08:58 2022] PUT /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe/users/22f75191120f427187cac18928d6a728/roles/2263be67ab644cd1bc02a99e16e1b369 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:08:59.322722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a418d-6373-474e-a902-b979fe2d8da1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:08:59.366911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e17ab-dbb7-4118-b6f5-78694024ed93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:08:59.367528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e17ab-dbb7-4118-b6f5-78694024ed93 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:59.367804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e17ab-dbb7-4118-b6f5-78694024ed93 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:59.368074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e17ab-dbb7-4118-b6f5-78694024ed93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:59.369083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e17ab-dbb7-4118-b6f5-78694024ed93 None admin] RBAC: Adding query filter params (role.id=e4dc6d4cfce94e67aa327307e8bd4190, scope.project.id=caad43ce957444119e369cbd62b3b9fe, user.id=99ea265c572f47668ed9768425933e35) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:08:59.369396 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e17ab-dbb7-4118-b6f5-78694024ed93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:08:59.370958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e17ab-dbb7-4118-b6f5-78694024ed93 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:08:59.377991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 143/294] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:08:59 2022] GET /identity/v3/role_assignments?user.id=99ea265c572f47668ed9768425933e35&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:08:59.764770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fe4c4-42f0-4cf0-ba72-f261214bac3e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:59.765462 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fe4c4-42f0-4cf0-ba72-f261214bac3e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:59.765977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fe4c4-42f0-4cf0-ba72-f261214bac3e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:59.767844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 152/295] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:08:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:08:59.773507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6cc76-ff78-40cc-bebb-8711c4b515fc None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:08:59.773802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6cc76-ff78-40cc-bebb-8711c4b515fc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:08:59.774106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6cc76-ff78-40cc-bebb-8711c4b515fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:08:59.798545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dfa6cc76-ff78-40cc-bebb-8711c4b515fc None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:08:59.799749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dfa6cc76-ff78-40cc-bebb-8711c4b515fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:08:59.881124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 144/296] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:00.150554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fe4c4-42f0-4cf0-ba72-f261214bac3e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:00.171627 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:00.199594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f1f7e-0917-4f68-b8fc-f5caddd208cf None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:00.200090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f1f7e-0917-4f68-b8fc-f5caddd208cf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:00.200162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f1f7e-0917-4f68-b8fc-f5caddd208cf None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:00.201529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 145/297] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:00.206601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3392d9-05fc-4de3-b6c0-73cc29cab402 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:00.206885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3392d9-05fc-4de3-b6c0-73cc29cab402 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:00.207160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3392d9-05fc-4de3-b6c0-73cc29cab402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:00.214530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:00.226337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ec3392d9-05fc-4de3-b6c0-73cc29cab402 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:00.227501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ec3392d9-05fc-4de3-b6c0-73cc29cab402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:00.260774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fe4c4-42f0-4cf0-ba72-f261214bac3e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:00.293323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 146/298] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:09:00.297295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13115f-6a72-4e43-8d2c-5375c6688b66 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:00.297295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13115f-6a72-4e43-8d2c-5375c6688b66 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:00.297295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13115f-6a72-4e43-8d2c-5375c6688b66 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:00.297295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 147/299] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:00.302885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d79cd-b17e-41c9-9d63-7d016ff80be7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:00.303528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d79cd-b17e-41c9-9d63-7d016ff80be7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:00.304085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d79cd-b17e-41c9-9d63-7d016ff80be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:00.304697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b5f9c-9f4c-4daa-a716-d19a2183a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:00.305409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b5f9c-9f4c-4daa-a716-d19a2183a0ec None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:00.305770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b5f9c-9f4c-4daa-a716-d19a2183a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:00.306145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b5f9c-9f4c-4daa-a716-d19a2183a0ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:00.317831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b5f9c-9f4c-4daa-a716-d19a2183a0ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-459b5f9c-9f4c-4daa-a716-d19a2183a0ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:00.322879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:00.323762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:00.324570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 153/300] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:00.329967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b5f9c-9f4c-4daa-a716-d19a2183a0ec None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:00.335067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c07d79cd-b17e-41c9-9d63-7d016ff80be7 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:00.336271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c07d79cd-b17e-41c9-9d63-7d016ff80be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:00.422255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 148/301] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:00.426560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:00.449793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b5f9c-9f4c-4daa-a716-d19a2183a0ec None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:00.486228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e9012-acb8-47ca-9e84-4536b3b80566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:00.487246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e9012-acb8-47ca-9e84-4536b3b80566 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:00.487721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e9012-acb8-47ca-9e84-4536b3b80566 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:00.488180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e9012-acb8-47ca-9e84-4536b3b80566 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:00.489057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e9012-acb8-47ca-9e84-4536b3b80566 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:00.489546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e9012-acb8-47ca-9e84-4536b3b80566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:00.491186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e9012-acb8-47ca-9e84-4536b3b80566 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:00.499939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 154/302] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:00.505763 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d79cd-b17e-41c9-9d63-7d016ff80be7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:00.565048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e9012-acb8-47ca-9e84-4536b3b80566 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:00.579688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:00.621100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d79cd-b17e-41c9-9d63-7d016ff80be7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:00.656747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5a5b-747f-49c5-9573-d2ac6066abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:00.657372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5a5b-747f-49c5-9573-d2ac6066abd7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:00.657649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5a5b-747f-49c5-9573-d2ac6066abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:00.657921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5a5b-747f-49c5-9573-d2ac6066abd7 None admin] PATH_INFO: `/v3/users/49ae17734bf34b82ac8e6595f4f3b263` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:00.659331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e5a5b-747f-49c5-9573-d2ac6066abd7 None admin] RBAC: Authorizing `identity:get_user(user_id=49ae17734bf34b82ac8e6595f4f3b263)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:00.660782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e5a5b-747f-49c5-9573-d2ac6066abd7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:00.662492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 149/303] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:09:00 2022] GET /identity/v3/users/49ae17734bf34b82ac8e6595f4f3b263 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:00.668022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5a5b-747f-49c5-9573-d2ac6066abd7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:00.693433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e9012-acb8-47ca-9e84-4536b3b80566 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:00.739580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4047-947b-4a35-b286-835ea68030c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:00.741111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4047-947b-4a35-b286-835ea68030c4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:00.741807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4047-947b-4a35-b286-835ea68030c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:00.742408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4047-947b-4a35-b286-835ea68030c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:00.743766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b4047-947b-4a35-b286-835ea68030c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:00.745305 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b4047-947b-4a35-b286-835ea68030c4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:00.747010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 155/304] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:00.752038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4047-947b-4a35-b286-835ea68030c4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:00.762649 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:00.774899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5a5b-747f-49c5-9573-d2ac6066abd7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:00.806554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:00.812947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1c297-a174-438f-9321-ffdfa7f1e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:00.813805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1c297-a174-438f-9321-ffdfa7f1e684 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:00.814311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1c297-a174-438f-9321-ffdfa7f1e684 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:00.814791 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1c297-a174-438f-9321-ffdfa7f1e684 None admin] PATH_INFO: `/v3/system/users/49ae17734bf34b82ac8e6595f4f3b263/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:00.816278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1c297-a174-438f-9321-ffdfa7f1e684 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=49ae17734bf34b82ac8e6595f4f3b263, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:00.817648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1c297-a174-438f-9321-ffdfa7f1e684 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:00.827726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 150/305] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Aug 19 15:09:00 2022] PUT /identity/v3/system/users/49ae17734bf34b82ac8e6595f4f3b263/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:09:00.828562 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1c297-a174-438f-9321-ffdfa7f1e684 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:00.897378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4047-947b-4a35-b286-835ea68030c4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:00.948197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d973d12-55d8-414d-9527-4fa489687c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:00.949345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d973d12-55d8-414d-9527-4fa489687c30 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:00.950196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d973d12-55d8-414d-9527-4fa489687c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:00.951690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d973d12-55d8-414d-9527-4fa489687c30 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:00.957072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1c297-a174-438f-9321-ffdfa7f1e684 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:00.967483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d973d12-55d8-414d-9527-4fa489687c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6d973d12-55d8-414d-9527-4fa489687c30 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:00.973717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:00.974825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:09:00.975799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:00.977730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 156/306] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:00.985410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d973d12-55d8-414d-9527-4fa489687c30 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:01.002419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845808f-6303-499a-9c23-42581b212fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:01.003176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845808f-6303-499a-9c23-42581b212fc2 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:01.003456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845808f-6303-499a-9c23-42581b212fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:01.003723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845808f-6303-499a-9c23-42581b212fc2 None admin] PATH_INFO: `/v3/groups` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:01.004347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845808f-6303-499a-9c23-42581b212fc2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:01.005808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845808f-6303-499a-9c23-42581b212fc2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:01.023207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 151/307] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Aug 19 15:09:00 2022] POST /identity/v3/groups => generated 229 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:09:01.074836 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:01.116652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d973d12-55d8-414d-9527-4fa489687c30 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:01.156567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc4ab3-9e12-4d93-aed3-ab0224af732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:01.157337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc4ab3-9e12-4d93-aed3-ab0224af732a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:01.157523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc4ab3-9e12-4d93-aed3-ab0224af732a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:01.157796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc4ab3-9e12-4d93-aed3-ab0224af732a None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:01.158590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc4ab3-9e12-4d93-aed3-ab0224af732a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:01.158962 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc4ab3-9e12-4d93-aed3-ab0224af732a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:01.160367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc4ab3-9e12-4d93-aed3-ab0224af732a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:01.171007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 157/308] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:01.179286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845808f-6303-499a-9c23-42581b212fc2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:01.242972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:01.292713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845808f-6303-499a-9c23-42581b212fc2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:01.331995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c325299-6287-4855-891d-9a7ac7d7e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:01.332631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325299-6287-4855-891d-9a7ac7d7e412 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:01.332907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325299-6287-4855-891d-9a7ac7d7e412 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:01.333174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325299-6287-4855-891d-9a7ac7d7e412 None admin] PATH_INFO: `/v3/users/d3d3a8370ee64186aa5d9094affb1268` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:01.346827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c325299-6287-4855-891d-9a7ac7d7e412 None admin] RBAC: Authorizing `identity:get_user(user_id=d3d3a8370ee64186aa5d9094affb1268)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:01.348430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c325299-6287-4855-891d-9a7ac7d7e412 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:01.350510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 152/309] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:09:01 2022] GET /identity/v3/users/d3d3a8370ee64186aa5d9094affb1268 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:01.357211 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc4ab3-9e12-4d93-aed3-ab0224af732a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:01.440383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f7521-5137-48d7-9a8f-bb401a02d7e4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:01.440691 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f7521-5137-48d7-9a8f-bb401a02d7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:01.440944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f7521-5137-48d7-9a8f-bb401a02d7e4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:01.442580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 153/310] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:09:01.447354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1d5b1-c081-4c27-bd8b-4e2f635ba7ff None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:01.447644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1d5b1-c081-4c27-bd8b-4e2f635ba7ff None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:01.447917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1d5b1-c081-4c27-bd8b-4e2f635ba7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:01.465803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-04f1d5b1-c081-4c27-bd8b-4e2f635ba7ff None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:01.467096 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-04f1d5b1-c081-4c27-bd8b-4e2f635ba7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:01.468323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc4ab3-9e12-4d93-aed3-ab0224af732a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:01.505926 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:01.514555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd357437-c915-42ad-93c2-1ec3ae5a7aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:01.515164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd357437-c915-42ad-93c2-1ec3ae5a7aaf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:01.515688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd357437-c915-42ad-93c2-1ec3ae5a7aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:01.515965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd357437-c915-42ad-93c2-1ec3ae5a7aaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:01.517176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd357437-c915-42ad-93c2-1ec3ae5a7aaf None admin] RBAC: Adding query filter params (role.id=2263be67ab644cd1bc02a99e16e1b369, user.id=d3d3a8370ee64186aa5d9094affb1268, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:01.517620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd357437-c915-42ad-93c2-1ec3ae5a7aaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:01.519212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd357437-c915-42ad-93c2-1ec3ae5a7aaf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:01.525445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 158/311] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 19 15:09:01 2022] GET /identity/v3/role_assignments?user.id=d3d3a8370ee64186aa5d9094affb1268&scope.system=all&role.id=2263be67ab644cd1bc02a99e16e1b369 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:01.548772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 154/312] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:09:01.827134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd357437-c915-42ad-93c2-1ec3ae5a7aaf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:01.936692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd357437-c915-42ad-93c2-1ec3ae5a7aaf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:01.972726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123b791-80fd-48e6-9a3e-b28d8b8990af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:01.973378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123b791-80fd-48e6-9a3e-b28d8b8990af None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:01.973658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123b791-80fd-48e6-9a3e-b28d8b8990af None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:01.973929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123b791-80fd-48e6-9a3e-b28d8b8990af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:01.986562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123b791-80fd-48e6-9a3e-b28d8b8990af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5123b791-80fd-48e6-9a3e-b28d8b8990af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:01.991820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:01.992682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:01.993590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 159/313] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:02.001140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1d5b1-c081-4c27-bd8b-4e2f635ba7ff None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:02.049070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:02.109178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1d5b1-c081-4c27-bd8b-4e2f635ba7ff None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:02.144913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc52b2-0297-4cf1-a114-9be6259cedf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:02.145523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc52b2-0297-4cf1-a114-9be6259cedf8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:02.145804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc52b2-0297-4cf1-a114-9be6259cedf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:02.146099 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc52b2-0297-4cf1-a114-9be6259cedf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:02.146762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc52b2-0297-4cf1-a114-9be6259cedf8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:02.147070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc52b2-0297-4cf1-a114-9be6259cedf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:02.148446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc52b2-0297-4cf1-a114-9be6259cedf8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:02.157658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 155/314] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:02.167103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123b791-80fd-48e6-9a3e-b28d8b8990af None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:02.229244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:02.275404 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123b791-80fd-48e6-9a3e-b28d8b8990af None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:02.309331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441a7b5-35e1-4458-b1d6-80a107acdff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:02.310526 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441a7b5-35e1-4458-b1d6-80a107acdff2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:02.310813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441a7b5-35e1-4458-b1d6-80a107acdff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:02.311083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441a7b5-35e1-4458-b1d6-80a107acdff2 None admin] PATH_INFO: `/v3/users/22f75191120f427187cac18928d6a728` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:02.312198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441a7b5-35e1-4458-b1d6-80a107acdff2 None admin] RBAC: Authorizing `identity:get_user(user_id=22f75191120f427187cac18928d6a728)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:02.313621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441a7b5-35e1-4458-b1d6-80a107acdff2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:02.315436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 160/315] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:09:02 2022] GET /identity/v3/users/22f75191120f427187cac18928d6a728 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:02.320878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc52b2-0297-4cf1-a114-9be6259cedf8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:02.431498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc52b2-0297-4cf1-a114-9be6259cedf8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:02.438597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:02.465800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f065a-b5fe-4932-931d-88d3aa73c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:02.467012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f065a-b5fe-4932-931d-88d3aa73c330 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:02.467292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f065a-b5fe-4932-931d-88d3aa73c330 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:02.467563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f065a-b5fe-4932-931d-88d3aa73c330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:02.545652 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f065a-b5fe-4932-931d-88d3aa73c330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:02.547115 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f065a-b5fe-4932-931d-88d3aa73c330 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:02.657361 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 156/316] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:02.663114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441a7b5-35e1-4458-b1d6-80a107acdff2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:02.773073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441a7b5-35e1-4458-b1d6-80a107acdff2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:02.796710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:02.809120 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07ee04-bf07-42da-93ba-11e9c1e0422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:02.810124 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07ee04-bf07-42da-93ba-11e9c1e0422e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:02.810577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07ee04-bf07-42da-93ba-11e9c1e0422e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:02.811025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07ee04-bf07-42da-93ba-11e9c1e0422e None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:02.812314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07ee04-bf07-42da-93ba-11e9c1e0422e None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:02.813933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07ee04-bf07-42da-93ba-11e9c1e0422e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:02.815879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 161/317] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:02 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:02.821825 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f065a-b5fe-4932-931d-88d3aa73c330 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:02.831246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:02.831754 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edba22-473e-4ad1-9be7-7d5ff6dd4040 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:02.832394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edba22-473e-4ad1-9be7-7d5ff6dd4040 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:02.832394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edba22-473e-4ad1-9be7-7d5ff6dd4040 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:02.833910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 162/318] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:09:02.839382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e982-9846-4fe3-81ea-3645a5847082 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:02.839672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e982-9846-4fe3-81ea-3645a5847082 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:02.840007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e982-9846-4fe3-81ea-3645a5847082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:02.858355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6466e982-9846-4fe3-81ea-3645a5847082 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:02.859535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6466e982-9846-4fe3-81ea-3645a5847082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:02.934417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 163/319] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:02.946776 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f065a-b5fe-4932-931d-88d3aa73c330 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:02.983478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b61987-0e43-411e-82c2-b291b469e457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:02.984429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b61987-0e43-411e-82c2-b291b469e457 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:02.984922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b61987-0e43-411e-82c2-b291b469e457 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:02.985399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b61987-0e43-411e-82c2-b291b469e457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:02.986363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b61987-0e43-411e-82c2-b291b469e457 None admin] RBAC: Adding query filter params (role.id=2263be67ab644cd1bc02a99e16e1b369, scope.project.id=caad43ce957444119e369cbd62b3b9fe, user.id=22f75191120f427187cac18928d6a728) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:02.986865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b61987-0e43-411e-82c2-b291b469e457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:02.988509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b61987-0e43-411e-82c2-b291b469e457 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:02.994811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 157/320] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:02 2022] GET /identity/v3/role_assignments?user.id=22f75191120f427187cac18928d6a728&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=2263be67ab644cd1bc02a99e16e1b369 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:03.072174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e062-9dd2-43ab-867c-0ee535226df6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:03.072512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e062-9dd2-43ab-867c-0ee535226df6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:03.072694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e062-9dd2-43ab-867c-0ee535226df6 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:03.074261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 164/321] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:03.079636 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fde40f-c3ec-4dd6-bf03-7d90174a1ace None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:03.079922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fde40f-c3ec-4dd6-bf03-7d90174a1ace None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:03.080196 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fde40f-c3ec-4dd6-bf03-7d90174a1ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:03.100092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-01fde40f-c3ec-4dd6-bf03-7d90174a1ace None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:03.101298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-01fde40f-c3ec-4dd6-bf03-7d90174a1ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:03.172882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:03.178798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 158/322] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:03.203862 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71e062-9dd2-43ab-867c-0ee535226df6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:03.306276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71e062-9dd2-43ab-867c-0ee535226df6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:03.326723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:03.341717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4b95d-6703-47f5-b0e5-c9cb4b2814a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:03.342382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4b95d-6703-47f5-b0e5-c9cb4b2814a5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:03.342663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4b95d-6703-47f5-b0e5-c9cb4b2814a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:03.342936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4b95d-6703-47f5-b0e5-c9cb4b2814a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:03.353027 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4b95d-6703-47f5-b0e5-c9cb4b2814a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b0b4b95d-6703-47f5-b0e5-c9cb4b2814a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:03.358064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:03.358948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:03.359716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:03.363175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 165/323] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:03.365243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fde40f-c3ec-4dd6-bf03-7d90174a1ace None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:03.443542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4b95d-6703-47f5-b0e5-c9cb4b2814a5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:03.466555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fde40f-c3ec-4dd6-bf03-7d90174a1ace None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:03.502058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30a9eb-47b6-4eeb-a725-2af404791aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:03.502704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30a9eb-47b6-4eeb-a725-2af404791aea None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:03.502942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30a9eb-47b6-4eeb-a725-2af404791aea None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:03.503211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30a9eb-47b6-4eeb-a725-2af404791aea None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:03.503872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30a9eb-47b6-4eeb-a725-2af404791aea None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:03.504172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30a9eb-47b6-4eeb-a725-2af404791aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:03.505522 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30a9eb-47b6-4eeb-a725-2af404791aea None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:03.513468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 159/324] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:03.514660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46749-5d67-4df0-a298-2dfb421db08b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:03.514932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46749-5d67-4df0-a298-2dfb421db08b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:03.515203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46749-5d67-4df0-a298-2dfb421db08b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:03.516392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 160/325] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:03.518902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee46749-5d67-4df0-a298-2dfb421db08b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:03.553064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4b95d-6703-47f5-b0e5-c9cb4b2814a5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:03.581461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:03.586709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf20b69-aa9a-44b7-8c0b-9e7a4d09ee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:03.587334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf20b69-aa9a-44b7-8c0b-9e7a4d09ee16 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:03.587610 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf20b69-aa9a-44b7-8c0b-9e7a4d09ee16 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:03.587878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf20b69-aa9a-44b7-8c0b-9e7a4d09ee16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:03.588973 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf20b69-aa9a-44b7-8c0b-9e7a4d09ee16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:03.590427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf20b69-aa9a-44b7-8c0b-9e7a4d09ee16 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:03.592060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 166/326] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:03.593143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760ea4c-1718-4b50-bdac-8aa39cecad34 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:03.593419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760ea4c-1718-4b50-bdac-8aa39cecad34 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:03.593685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760ea4c-1718-4b50-bdac-8aa39cecad34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:03.611126 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7760ea4c-1718-4b50-bdac-8aa39cecad34 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:03.612358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7760ea4c-1718-4b50-bdac-8aa39cecad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:03.621449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee46749-5d67-4df0-a298-2dfb421db08b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:03.654509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:03.654652 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265acbc6-c74e-40d2-a30e-ceb06aedf374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:03.655237 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265acbc6-c74e-40d2-a30e-ceb06aedf374 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:03.655867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265acbc6-c74e-40d2-a30e-ceb06aedf374 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:03.656215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265acbc6-c74e-40d2-a30e-ceb06aedf374 None admin] PATH_INFO: `/v3/users/49ae17734bf34b82ac8e6595f4f3b263` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:03.657439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265acbc6-c74e-40d2-a30e-ceb06aedf374 None admin] RBAC: Authorizing `identity:get_user(user_id=49ae17734bf34b82ac8e6595f4f3b263)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:03.658939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265acbc6-c74e-40d2-a30e-ceb06aedf374 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:03.660517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 161/327] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:09:03 2022] GET /identity/v3/users/49ae17734bf34b82ac8e6595f4f3b263 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:03.661229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265acbc6-c74e-40d2-a30e-ceb06aedf374 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:03.678074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 167/328] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:03.678888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760ea4c-1718-4b50-bdac-8aa39cecad34 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:03.772884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265acbc6-c74e-40d2-a30e-ceb06aedf374 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:03.782307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760ea4c-1718-4b50-bdac-8aa39cecad34 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:03.803088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:03.810513 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd7506-4dcc-4b23-8477-d1e01e7bc090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:03.811419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd7506-4dcc-4b23-8477-d1e01e7bc090 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:03.811939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd7506-4dcc-4b23-8477-d1e01e7bc090 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:03.812391 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd7506-4dcc-4b23-8477-d1e01e7bc090 None admin] PATH_INFO: `/v3/groups` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:03.813079 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd7506-4dcc-4b23-8477-d1e01e7bc090 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:03.814592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd7506-4dcc-4b23-8477-d1e01e7bc090 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:03.816601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e8944-2868-4066-a16f-13efdf5351ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:03.817210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e8944-2868-4066-a16f-13efdf5351ad None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:03.817492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e8944-2868-4066-a16f-13efdf5351ad None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:03.817831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e8944-2868-4066-a16f-13efdf5351ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:03.818523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e8944-2868-4066-a16f-13efdf5351ad None admin] RBAC: Adding query filter params (role.id=e4dc6d4cfce94e67aa327307e8bd4190, user.id=49ae17734bf34b82ac8e6595f4f3b263, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:03.818830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e8944-2868-4066-a16f-13efdf5351ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:03.820324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e8944-2868-4066-a16f-13efdf5351ad None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:03.829807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 162/329] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Aug 19 15:09:03 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:09:03.838151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 168/330] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 19 15:09:03 2022] GET /identity/v3/role_assignments?user.id=49ae17734bf34b82ac8e6595f4f3b263&scope.system=all&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 510 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:03.946652 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd7506-4dcc-4b23-8477-d1e01e7bc090 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:04.056541 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd7506-4dcc-4b23-8477-d1e01e7bc090 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:04.092235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b1f56-fdb2-4d94-8bb8-e2690e5fcbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:04.092791 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1f56-fdb2-4d94-8bb8-e2690e5fcbc6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:04.093073 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1f56-fdb2-4d94-8bb8-e2690e5fcbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:04.093347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1f56-fdb2-4d94-8bb8-e2690e5fcbc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:04.103553 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b1f56-fdb2-4d94-8bb8-e2690e5fcbc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-029b1f56-fdb2-4d94-8bb8-e2690e5fcbc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:04.109696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:04.110802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:09:04.111771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:04.115660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 163/331] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:04.117001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e8944-2868-4066-a16f-13efdf5351ad None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:04.154386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:04.223638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e8944-2868-4066-a16f-13efdf5351ad None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:04.259779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9594700-8553-4d7a-9dcb-67e279769782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:04.260402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9594700-8553-4d7a-9dcb-67e279769782 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:04.260685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9594700-8553-4d7a-9dcb-67e279769782 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:04.260963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9594700-8553-4d7a-9dcb-67e279769782 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:04.261702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9594700-8553-4d7a-9dcb-67e279769782 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:04.262009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9594700-8553-4d7a-9dcb-67e279769782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:04.264003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9594700-8553-4d7a-9dcb-67e279769782 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:04.272993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 169/332] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:04.278545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b1f56-fdb2-4d94-8bb8-e2690e5fcbc6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:04.330717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:04.389363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b1f56-fdb2-4d94-8bb8-e2690e5fcbc6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:04.425366 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44798e-ea49-44c1-a60a-3ecf3df037f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:04.426006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44798e-ea49-44c1-a60a-3ecf3df037f0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:04.426325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44798e-ea49-44c1-a60a-3ecf3df037f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:04.426590 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44798e-ea49-44c1-a60a-3ecf3df037f0 None admin] PATH_INFO: `/v3/users/d3d3a8370ee64186aa5d9094affb1268` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:04.427744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44798e-ea49-44c1-a60a-3ecf3df037f0 None admin] RBAC: Authorizing `identity:get_user(user_id=d3d3a8370ee64186aa5d9094affb1268)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:04.429182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44798e-ea49-44c1-a60a-3ecf3df037f0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:04.431172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 164/333] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:09:04 2022] GET /identity/v3/users/d3d3a8370ee64186aa5d9094affb1268 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:04.436452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9594700-8553-4d7a-9dcb-67e279769782 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:04.561137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:04.565249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9594700-8553-4d7a-9dcb-67e279769782 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:04.603950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd90085-8b64-4459-a91a-8cf0512adeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:04.604876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90085-8b64-4459-a91a-8cf0512adeb4 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:04.605159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90085-8b64-4459-a91a-8cf0512adeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:04.605434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90085-8b64-4459-a91a-8cf0512adeb4 None admin] PATH_INFO: `/v3/system/users/d3d3a8370ee64186aa5d9094affb1268/roles/2263be67ab644cd1bc02a99e16e1b369` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:04.606944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd90085-8b64-4459-a91a-8cf0512adeb4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d3d3a8370ee64186aa5d9094affb1268, role_id=2263be67ab644cd1bc02a99e16e1b369)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:04.608340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd90085-8b64-4459-a91a-8cf0512adeb4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:04.620908 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 170/334] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Aug 19 15:09:04 2022] PUT /identity/v3/system/users/d3d3a8370ee64186aa5d9094affb1268/roles/2263be67ab644cd1bc02a99e16e1b369 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:09:05.968152 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72038f67-98d1-4230-8e57-12fe87dda563 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:05.968973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72038f67-98d1-4230-8e57-12fe87dda563 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:05.969421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72038f67-98d1-4230-8e57-12fe87dda563 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:05.971205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 165/335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:05.976195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2139-f5a6-4837-9bc7-d268fe3f3ed3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:05.977025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2139-f5a6-4837-9bc7-d268fe3f3ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:05.977503 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2139-f5a6-4837-9bc7-d268fe3f3ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:06.002453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fe7b2139-f5a6-4837-9bc7-d268fe3f3ed3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:06.004000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fe7b2139-f5a6-4837-9bc7-d268fe3f3ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:06.090703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 171/336] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:06.409945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72038f67-98d1-4230-8e57-12fe87dda563 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:06.546674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72038f67-98d1-4230-8e57-12fe87dda563 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:06.586782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:06.594068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae5bfa-ae9f-4f97-9189-fface53ab5ab None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:06.594361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae5bfa-ae9f-4f97-9189-fface53ab5ab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:06.594636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae5bfa-ae9f-4f97-9189-fface53ab5ab None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:06.596236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 172/337] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:06.601244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31ed90-387b-4c34-a9a2-53a3898eb935 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:06.601817 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31ed90-387b-4c34-a9a2-53a3898eb935 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:06.602344 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31ed90-387b-4c34-a9a2-53a3898eb935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:06.602707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857b34d-9ca5-412c-8993-79cb9904f37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:06.603369 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b34d-9ca5-412c-8993-79cb9904f37b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:06.603741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b34d-9ca5-412c-8993-79cb9904f37b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:06.604020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b34d-9ca5-412c-8993-79cb9904f37b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:06.622071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857b34d-9ca5-412c-8993-79cb9904f37b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f857b34d-9ca5-412c-8993-79cb9904f37b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:06.624463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:06.625341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:06.626525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 166/338] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:06.631172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857b34d-9ca5-412c-8993-79cb9904f37b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:06.640840 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dc31ed90-387b-4c34-a9a2-53a3898eb935 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:06.642463 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dc31ed90-387b-4c34-a9a2-53a3898eb935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:06.752348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 173/339] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:06.813910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857b34d-9ca5-412c-8993-79cb9904f37b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:06.857061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96f5b8-7432-403c-9a0c-c3764847284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:06.857662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96f5b8-7432-403c-9a0c-c3764847284a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:06.857940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96f5b8-7432-403c-9a0c-c3764847284a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:06.858240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96f5b8-7432-403c-9a0c-c3764847284a None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:06.858888 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96f5b8-7432-403c-9a0c-c3764847284a None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:06.859185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96f5b8-7432-403c-9a0c-c3764847284a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:06.860537 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96f5b8-7432-403c-9a0c-c3764847284a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:06.874100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 167/340] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:06.879710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31ed90-387b-4c34-a9a2-53a3898eb935 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:06.916992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:07.012355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31ed90-387b-4c34-a9a2-53a3898eb935 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:07.056667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee047f-a1c5-4a93-8112-f8a7496df5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:07.057691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee047f-a1c5-4a93-8112-f8a7496df5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:07.058262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee047f-a1c5-4a93-8112-f8a7496df5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:07.058770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee047f-a1c5-4a93-8112-f8a7496df5d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:07.133047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee047f-a1c5-4a93-8112-f8a7496df5d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:07.135038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee047f-a1c5-4a93-8112-f8a7496df5d3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:07.161317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:07.209695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96f5b8-7432-403c-9a0c-c3764847284a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:07.279083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 174/341] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:07.280281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115e45a-ef91-45c7-8d4c-6b266d8a4069 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:07.280566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115e45a-ef91-45c7-8d4c-6b266d8a4069 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:07.280842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115e45a-ef91-45c7-8d4c-6b266d8a4069 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:07.282207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 175/342] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:07.286920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115e45a-ef91-45c7-8d4c-6b266d8a4069 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:07.287193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:07.390903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96f5b8-7432-403c-9a0c-c3764847284a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:07.437462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff4cec-292c-4070-bc8d-a7cb1fe98e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:07.438217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115e45a-ef91-45c7-8d4c-6b266d8a4069 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:07.438545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff4cec-292c-4070-bc8d-a7cb1fe98e9e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:07.438969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff4cec-292c-4070-bc8d-a7cb1fe98e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:07.439412 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff4cec-292c-4070-bc8d-a7cb1fe98e9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:07.454155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ff4cec-292c-4070-bc8d-a7cb1fe98e9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-94ff4cec-292c-4070-bc8d-a7cb1fe98e9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:07.461672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:07.462772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:07.463753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:07.466845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 168/343] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:09:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:07.467511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:07.469619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7fea0-abb5-4a8e-bfe7-cf58df8df05c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:07.470080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7fea0-abb5-4a8e-bfe7-cf58df8df05c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:07.470568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7fea0-abb5-4a8e-bfe7-cf58df8df05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:07.485838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3980e4-1753-44f6-9a3a-f6b364fa7cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:07.486734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3980e4-1753-44f6-9a3a-f6b364fa7cdd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:07.487112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3980e4-1753-44f6-9a3a-f6b364fa7cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:07.487504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3980e4-1753-44f6-9a3a-f6b364fa7cdd None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:07.488725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3980e4-1753-44f6-9a3a-f6b364fa7cdd None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:07.490317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3980e4-1753-44f6-9a3a-f6b364fa7cdd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:07.492230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 176/344] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:07 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:07.493274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec20a-f688-483d-bc76-e9e80d9320c4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:07.493648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec20a-f688-483d-bc76-e9e80d9320c4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:07.494169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5fe7fea0-abb5-4a8e-bfe7-cf58df8df05c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:07.495514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5fe7fea0-abb5-4a8e-bfe7-cf58df8df05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:07.498500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec20a-f688-483d-bc76-e9e80d9320c4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:07.500037 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 177/345] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:07.500732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ec20a-f688-483d-bc76-e9e80d9320c4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:07.588979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 169/346] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:07.589829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7fea0-abb5-4a8e-bfe7-cf58df8df05c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:07.629772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:07.638800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ec20a-f688-483d-bc76-e9e80d9320c4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:07.692201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d48c6-451f-43a6-85e5-b22695be1bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:07.693302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d48c6-451f-43a6-85e5-b22695be1bed None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:07.693592 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d48c6-451f-43a6-85e5-b22695be1bed None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:07.693870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d48c6-451f-43a6-85e5-b22695be1bed None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:07.694837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d48c6-451f-43a6-85e5-b22695be1bed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:07.695164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d48c6-451f-43a6-85e5-b22695be1bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:07.696793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d48c6-451f-43a6-85e5-b22695be1bed None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:07.713543 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 178/347] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:07.715255 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59446913-c49e-48f9-ba89-94b246d8a17e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:07.717406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59446913-c49e-48f9-ba89-94b246d8a17e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:07.718594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59446913-c49e-48f9-ba89-94b246d8a17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:07.727987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7fea0-abb5-4a8e-bfe7-cf58df8df05c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:07.755829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-59446913-c49e-48f9-ba89-94b246d8a17e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:07.759937 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-59446913-c49e-48f9-ba89-94b246d8a17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:07.795472 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df667d05-8c18-4f72-a698-d7e512734baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:07.796480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df667d05-8c18-4f72-a698-d7e512734baa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:07.797476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df667d05-8c18-4f72-a698-d7e512734baa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:07.798630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df667d05-8c18-4f72-a698-d7e512734baa None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:07.812579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df667d05-8c18-4f72-a698-d7e512734baa None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:07.815436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df667d05-8c18-4f72-a698-d7e512734baa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:07.818231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 170/348] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:07 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:07.819378 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df667d05-8c18-4f72-a698-d7e512734baa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:07.871385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:07.913765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 179/349] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:07.914990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59446913-c49e-48f9-ba89-94b246d8a17e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:07.989135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:08.000902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df667d05-8c18-4f72-a698-d7e512734baa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:08.042213 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59446913-c49e-48f9-ba89-94b246d8a17e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:08.051681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1fbf-72c8-4a3a-8aef-8612df3797da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:08.052307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1fbf-72c8-4a3a-8aef-8612df3797da None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.052589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1fbf-72c8-4a3a-8aef-8612df3797da None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.052865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1fbf-72c8-4a3a-8aef-8612df3797da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.086392 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948db39-dea0-4b32-9988-2e309d19306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:08.087165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948db39-dea0-4b32-9988-2e309d19306c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.087444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948db39-dea0-4b32-9988-2e309d19306c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.087715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948db39-dea0-4b32-9988-2e309d19306c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.088438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948db39-dea0-4b32-9988-2e309d19306c None admin] RBAC: Adding query filter params (group.id=15828c4c01ee494e825fff221fb4f49e, role.id=e4dc6d4cfce94e67aa327307e8bd4190, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:08.088746 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948db39-dea0-4b32-9988-2e309d19306c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:08.092400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948db39-dea0-4b32-9988-2e309d19306c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:08.100163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 180/350] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 19 15:09:07 2022] GET /identity/v3/role_assignments?group.id=15828c4c01ee494e825fff221fb4f49e&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:08.100979 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948db39-dea0-4b32-9988-2e309d19306c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:08.165393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f1fbf-72c8-4a3a-8aef-8612df3797da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:08.166939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f1fbf-72c8-4a3a-8aef-8612df3797da None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:08.202450 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:08.276161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948db39-dea0-4b32-9988-2e309d19306c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:08.319559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd12652-ea28-47a2-9321-9a114c23e61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:08.320720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd12652-ea28-47a2-9321-9a114c23e61f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.321127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd12652-ea28-47a2-9321-9a114c23e61f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.321410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd12652-ea28-47a2-9321-9a114c23e61f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.323038 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:08.330901 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 171/351] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:08.332665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cffb5-29c8-4bc2-8636-9f5a85997e4e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.332961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cffb5-29c8-4bc2-8636-9f5a85997e4e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.333236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cffb5-29c8-4bc2-8636-9f5a85997e4e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.334645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 172/352] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:08.335493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cffb5-29c8-4bc2-8636-9f5a85997e4e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:08.335680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd12652-ea28-47a2-9321-9a114c23e61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0cd12652-ea28-47a2-9321-9a114c23e61f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:08.343578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:08.344490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:08.345707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 181/353] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:08.346691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d0f3a-ff0d-482e-99aa-491f09eff45c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.346691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d0f3a-ff0d-482e-99aa-491f09eff45c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.346813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d0f3a-ff0d-482e-99aa-491f09eff45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.372993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f64d0f3a-ff0d-482e-99aa-491f09eff45c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:08.374881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f64d0f3a-ff0d-482e-99aa-491f09eff45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:08.457507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 182/354] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:08.459002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d0f3a-ff0d-482e-99aa-491f09eff45c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:08.465788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cffb5-29c8-4bc2-8636-9f5a85997e4e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:08.507524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005caee6-7bd3-4c14-88be-0467c934d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:08.508163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005caee6-7bd3-4c14-88be-0467c934d77e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.508440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005caee6-7bd3-4c14-88be-0467c934d77e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.508721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005caee6-7bd3-4c14-88be-0467c934d77e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.510290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:08.521247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005caee6-7bd3-4c14-88be-0467c934d77e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-005caee6-7bd3-4c14-88be-0467c934d77e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:08.526014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:08.528185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 173/355] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:08.529593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005caee6-7bd3-4c14-88be-0467c934d77e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:08.598556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:08.605745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d0f3a-ff0d-482e-99aa-491f09eff45c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:08.649068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661c7d4-d373-474b-aee6-2c6ec9c3a690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:08.650099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661c7d4-d373-474b-aee6-2c6ec9c3a690 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.651483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661c7d4-d373-474b-aee6-2c6ec9c3a690 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.652800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661c7d4-d373-474b-aee6-2c6ec9c3a690 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.654902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661c7d4-d373-474b-aee6-2c6ec9c3a690 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:08.657269 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661c7d4-d373-474b-aee6-2c6ec9c3a690 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:08.660249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 183/356] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:08 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:08.662185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c02a7-774a-45e1-8ad2-05c813ae8f34 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.662776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c02a7-774a-45e1-8ad2-05c813ae8f34 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.663277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c02a7-774a-45e1-8ad2-05c813ae8f34 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.664460 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005caee6-7bd3-4c14-88be-0467c934d77e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:08.665108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 184/357] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:08.665991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c02a7-774a-45e1-8ad2-05c813ae8f34 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:08.705739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a8fab-0a3a-40b7-aff0-bfafc0e6a829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:08.706736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8fab-0a3a-40b7-aff0-bfafc0e6a829 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.707219 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8fab-0a3a-40b7-aff0-bfafc0e6a829 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.707688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a8fab-0a3a-40b7-aff0-bfafc0e6a829 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.708584 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a8fab-0a3a-40b7-aff0-bfafc0e6a829 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:08.709105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a8fab-0a3a-40b7-aff0-bfafc0e6a829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:08.710713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a8fab-0a3a-40b7-aff0-bfafc0e6a829 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:08.722830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 174/358] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:08.723972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a8fab-0a3a-40b7-aff0-bfafc0e6a829 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:08.791857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c02a7-774a-45e1-8ad2-05c813ae8f34 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:08.794946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:08.833704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a8fab-0a3a-40b7-aff0-bfafc0e6a829 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:08.839728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327acdb-d2bf-4312-8cef-b50a5f96b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:08.840346 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327acdb-d2bf-4312-8cef-b50a5f96b336 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.840627 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327acdb-d2bf-4312-8cef-b50a5f96b336 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.840952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327acdb-d2bf-4312-8cef-b50a5f96b336 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.842690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327acdb-d2bf-4312-8cef-b50a5f96b336 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:08.843001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327acdb-d2bf-4312-8cef-b50a5f96b336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:08.844766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327acdb-d2bf-4312-8cef-b50a5f96b336 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:08.854921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 185/359] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:08.856067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3822ef-1292-4e55-b899-3a8e65e12965 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.856351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3822ef-1292-4e55-b899-3a8e65e12965 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.856664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3822ef-1292-4e55-b899-3a8e65e12965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.859808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:08.875823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5b3822ef-1292-4e55-b899-3a8e65e12965 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:08.876664 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68316f1-abb3-4b8e-b40a-e3ea791cb3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:08.877127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5b3822ef-1292-4e55-b899-3a8e65e12965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:08.877309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68316f1-abb3-4b8e-b40a-e3ea791cb3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:08.877592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68316f1-abb3-4b8e-b40a-e3ea791cb3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:08.877869 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68316f1-abb3-4b8e-b40a-e3ea791cb3a0 None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:08.879041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68316f1-abb3-4b8e-b40a-e3ea791cb3a0 None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:08.880698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68316f1-abb3-4b8e-b40a-e3ea791cb3a0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:08.882564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 175/360] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:08 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:08.886683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68316f1-abb3-4b8e-b40a-e3ea791cb3a0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:08.962550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 186/361] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:08.963668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3822ef-1292-4e55-b899-3a8e65e12965 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:09.009444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68316f1-abb3-4b8e-b40a-e3ea791cb3a0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:09.045401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a1b44-f0b1-49a2-97cf-a440947359f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:09.046059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a1b44-f0b1-49a2-97cf-a440947359f1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:09.046341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a1b44-f0b1-49a2-97cf-a440947359f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:09.046615 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a1b44-f0b1-49a2-97cf-a440947359f1 None admin] PATH_INFO: `/v3/users/d3d3a8370ee64186aa5d9094affb1268` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:09.047853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a1b44-f0b1-49a2-97cf-a440947359f1 None admin] RBAC: Authorizing `identity:get_user(user_id=d3d3a8370ee64186aa5d9094affb1268)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:09.049395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a1b44-f0b1-49a2-97cf-a440947359f1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:09.051005 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 176/362] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:09:08 2022] GET /identity/v3/users/d3d3a8370ee64186aa5d9094affb1268 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:09.051777 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a1b44-f0b1-49a2-97cf-a440947359f1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:09.074964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:09.083301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3822ef-1292-4e55-b899-3a8e65e12965 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:09.112366 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:09.119408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468e8b-11f1-485c-9a58-025ddb64d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:09.120299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468e8b-11f1-485c-9a58-025ddb64d5ad None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:09.120802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468e8b-11f1-485c-9a58-025ddb64d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:09.121287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf468e8b-11f1-485c-9a58-025ddb64d5ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:09.134101 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf468e8b-11f1-485c-9a58-025ddb64d5ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cf468e8b-11f1-485c-9a58-025ddb64d5ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:09.139949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:09.140814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:09.141602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:09.144032 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 187/363] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:09:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:09.145092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468e8b-11f1-485c-9a58-025ddb64d5ad None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:09.164921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a1b44-f0b1-49a2-97cf-a440947359f1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:09.201759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f88319-5ebc-47c0-ba25-8b326b3713c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:09.202402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f88319-5ebc-47c0-ba25-8b326b3713c5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:09.202685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f88319-5ebc-47c0-ba25-8b326b3713c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:09.202962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f88319-5ebc-47c0-ba25-8b326b3713c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:09.267800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf468e8b-11f1-485c-9a58-025ddb64d5ad None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:09.277546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f88319-5ebc-47c0-ba25-8b326b3713c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:09.279195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f88319-5ebc-47c0-ba25-8b326b3713c5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:09.312335 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80299d7-0600-4215-920a-a2f2ce66b547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:09.313221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80299d7-0600-4215-920a-a2f2ce66b547 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:09.313510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80299d7-0600-4215-920a-a2f2ce66b547 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:09.313789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80299d7-0600-4215-920a-a2f2ce66b547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:09.314582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80299d7-0600-4215-920a-a2f2ce66b547 None admin] RBAC: Adding query filter params (group.id=15828c4c01ee494e825fff221fb4f49e, role.id=924c0aaeca9d4fa6924529f3f93a2f7e, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:09.315122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80299d7-0600-4215-920a-a2f2ce66b547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:09.317361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80299d7-0600-4215-920a-a2f2ce66b547 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:09.325134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 188/364] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 19 15:09:09 2022] GET /identity/v3/role_assignments?group.id=15828c4c01ee494e825fff221fb4f49e&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=924c0aaeca9d4fa6924529f3f93a2f7e => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:09.326398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80299d7-0600-4215-920a-a2f2ce66b547 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:09.346433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:09.358725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:09.422688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 177/365] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:09.425109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f88319-5ebc-47c0-ba25-8b326b3713c5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:09.468232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80299d7-0600-4215-920a-a2f2ce66b547 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:09.509276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59a5ae-86f4-44d0-a90a-d1030c031aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:09.509893 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59a5ae-86f4-44d0-a90a-d1030c031aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:09.510219 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59a5ae-86f4-44d0-a90a-d1030c031aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:09.510495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59a5ae-86f4-44d0-a90a-d1030c031aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:09.514598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59a5ae-86f4-44d0-a90a-d1030c031aa9 None admin] RBAC: Adding query filter params (role.id=2263be67ab644cd1bc02a99e16e1b369, user.id=d3d3a8370ee64186aa5d9094affb1268, scope.system=all) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:09.514961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59a5ae-86f4-44d0-a90a-d1030c031aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:09.516435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59a5ae-86f4-44d0-a90a-d1030c031aa9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:09.541404 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 189/366] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Aug 19 15:09:09 2022] GET /identity/v3/role_assignments?user.id=d3d3a8370ee64186aa5d9094affb1268&scope.system=all&role.id=2263be67ab644cd1bc02a99e16e1b369 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:09.542356 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59a5ae-86f4-44d0-a90a-d1030c031aa9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:09.548345 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f88319-5ebc-47c0-ba25-8b326b3713c5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:09.616856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca1973-bdb7-43d3-80f0-80ffc096b7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:09.617483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca1973-bdb7-43d3-80f0-80ffc096b7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:09.617763 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca1973-bdb7-43d3-80f0-80ffc096b7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:09.618051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca1973-bdb7-43d3-80f0-80ffc096b7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:09.618807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca1973-bdb7-43d3-80f0-80ffc096b7e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:09.619119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca1973-bdb7-43d3-80f0-80ffc096b7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:09.620517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca1973-bdb7-43d3-80f0-80ffc096b7e2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:09.635967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 178/367] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:09.636650 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca1973-bdb7-43d3-80f0-80ffc096b7e2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:09.675423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:09.680841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:09.707792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59a5ae-86f4-44d0-a90a-d1030c031aa9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:09.764250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7906a-2c19-40c1-90c3-fa861e486d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:09.764904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7906a-2c19-40c1-90c3-fa861e486d1d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:09.765294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7906a-2c19-40c1-90c3-fa861e486d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:09.765573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7906a-2c19-40c1-90c3-fa861e486d1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:09.779448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7906a-2c19-40c1-90c3-fa861e486d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c3f7906a-2c19-40c1-90c3-fa861e486d1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:09.784944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:09.785822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:09.786670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 190/368] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:09.790929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7906a-2c19-40c1-90c3-fa861e486d1d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:09.832072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca1973-bdb7-43d3-80f0-80ffc096b7e2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:09.875708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec53856-d961-47e5-8ed5-f55c7df0389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:09.876353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec53856-d961-47e5-8ed5-f55c7df0389a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:09.876643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec53856-d961-47e5-8ed5-f55c7df0389a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:09.876911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec53856-d961-47e5-8ed5-f55c7df0389a None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:09.878100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec53856-d961-47e5-8ed5-f55c7df0389a None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:09.879629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec53856-d961-47e5-8ed5-f55c7df0389a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:09.882626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 179/369] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:09 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:09.883801 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec53856-d961-47e5-8ed5-f55c7df0389a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:09.912683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7906a-2c19-40c1-90c3-fa861e486d1d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:09.964566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed45ae1-a978-49a7-a6a5-75ea1591aa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:09.965175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45ae1-a978-49a7-a6a5-75ea1591aa92 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:09.965829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45ae1-a978-49a7-a6a5-75ea1591aa92 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:09.966316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45ae1-a978-49a7-a6a5-75ea1591aa92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:09.977740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:09.995873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:10.021261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec53856-d961-47e5-8ed5-f55c7df0389a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:10.059488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795e3ea-30df-420c-b869-6e94a74a82b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:10.061056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e3ea-30df-420c-b869-6e94a74a82b6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:10.061634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e3ea-30df-420c-b869-6e94a74a82b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:10.062155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795e3ea-30df-420c-b869-6e94a74a82b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:10.063104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795e3ea-30df-420c-b869-6e94a74a82b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:10.063656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795e3ea-30df-420c-b869-6e94a74a82b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:10.063762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed45ae1-a978-49a7-a6a5-75ea1591aa92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:10.065241 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed45ae1-a978-49a7-a6a5-75ea1591aa92 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:10.065642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795e3ea-30df-420c-b869-6e94a74a82b6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:10.076785 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 180/370] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:10.078104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795e3ea-30df-420c-b869-6e94a74a82b6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:10.197837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 191/371] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:10.199494 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed45ae1-a978-49a7-a6a5-75ea1591aa92 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:10.222098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795e3ea-30df-420c-b869-6e94a74a82b6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:10.248940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:10.267380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cbc64-a456-4cde-a2e8-64b001f27c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:10.268308 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cbc64-a456-4cde-a2e8-64b001f27c90 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:10.268742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cbc64-a456-4cde-a2e8-64b001f27c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:10.269149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5cbc64-a456-4cde-a2e8-64b001f27c90 None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:10.270441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cbc64-a456-4cde-a2e8-64b001f27c90 None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:10.272764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5cbc64-a456-4cde-a2e8-64b001f27c90 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:10.275572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 181/372] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:10 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:10.276483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cbc64-a456-4cde-a2e8-64b001f27c90 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:10.295229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:10.347058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed45ae1-a978-49a7-a6a5-75ea1591aa92 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:10.391681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8fb25-1c63-4d09-aa73-43dc4b4efdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:10.392328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8fb25-1c63-4d09-aa73-43dc4b4efdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:10.392609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8fb25-1c63-4d09-aa73-43dc4b4efdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:10.392936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8fb25-1c63-4d09-aa73-43dc4b4efdd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:10.411941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5cbc64-a456-4cde-a2e8-64b001f27c90 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:10.459823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c189a-92f3-4687-b810-1841ffc3bdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:10.460463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c189a-92f3-4687-b810-1841ffc3bdca None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:10.460740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c189a-92f3-4687-b810-1841ffc3bdca None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:10.461011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c189a-92f3-4687-b810-1841ffc3bdca None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:10.463041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c189a-92f3-4687-b810-1841ffc3bdca None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:10.463638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c189a-92f3-4687-b810-1841ffc3bdca None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:10.469252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 182/373] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:10 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:10.470261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c189a-92f3-4687-b810-1841ffc3bdca None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:10.483548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8fb25-1c63-4d09-aa73-43dc4b4efdd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:10.485016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8fb25-1c63-4d09-aa73-43dc4b4efdd7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:10.539597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:10.583792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:10.617688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c189a-92f3-4687-b810-1841ffc3bdca None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:10.628583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 192/374] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:10.635146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedeffc-0acd-47b7-b0e5-ecbccf512083 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:10.635549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedeffc-0acd-47b7-b0e5-ecbccf512083 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:10.635826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedeffc-0acd-47b7-b0e5-ecbccf512083 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:10.637496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 193/375] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:10.638371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedeffc-0acd-47b7-b0e5-ecbccf512083 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:10.657266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985fa0a-61dd-4db2-b899-b1fc99f3512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:10.658069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985fa0a-61dd-4db2-b899-b1fc99f3512f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:10.658211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985fa0a-61dd-4db2-b899-b1fc99f3512f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:10.658448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985fa0a-61dd-4db2-b899-b1fc99f3512f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:10.659181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985fa0a-61dd-4db2-b899-b1fc99f3512f None admin] RBAC: Adding query filter params (group.id=15828c4c01ee494e825fff221fb4f49e, role.id=e4dc6d4cfce94e67aa327307e8bd4190, scope.project.id=caad43ce957444119e369cbd62b3b9fe) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:10.659492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985fa0a-61dd-4db2-b899-b1fc99f3512f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:10.660970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985fa0a-61dd-4db2-b899-b1fc99f3512f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:10.667972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 183/376] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 19 15:09:10 2022] GET /identity/v3/role_assignments?group.id=15828c4c01ee494e825fff221fb4f49e&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:10.668606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985fa0a-61dd-4db2-b899-b1fc99f3512f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:10.786548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedeffc-0acd-47b7-b0e5-ecbccf512083 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:10.817918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985fa0a-61dd-4db2-b899-b1fc99f3512f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:10.834387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e35c9e-977f-4731-853c-effb5aac20fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:10.835036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35c9e-977f-4731-853c-effb5aac20fc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:10.835320 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35c9e-977f-4731-853c-effb5aac20fc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:10.835595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35c9e-977f-4731-853c-effb5aac20fc None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:10.836723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e35c9e-977f-4731-853c-effb5aac20fc None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:10.838286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e35c9e-977f-4731-853c-effb5aac20fc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:10.839853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 194/377] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:10 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:10.841008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55985cb4-210f-420c-aa75-310a882e53f4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:10.841295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55985cb4-210f-420c-aa75-310a882e53f4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:10.841570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55985cb4-210f-420c-aa75-310a882e53f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:10.855675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:10.861281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-55985cb4-210f-420c-aa75-310a882e53f4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:10.862553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-55985cb4-210f-420c-aa75-310a882e53f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:10.863167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbe551-a34f-452d-a9a6-14ef41f93122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:10.863874 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbe551-a34f-452d-a9a6-14ef41f93122 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:10.864156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbe551-a34f-452d-a9a6-14ef41f93122 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:10.864428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbe551-a34f-452d-a9a6-14ef41f93122 None admin] PATH_INFO: `/v3/projects/b0c58200470045b79a04ba5897774f1b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:10.865560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbe551-a34f-452d-a9a6-14ef41f93122 None admin] RBAC: Authorizing `identity:get_project(project_id=b0c58200470045b79a04ba5897774f1b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:10.867057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbe551-a34f-452d-a9a6-14ef41f93122 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:10.868858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 184/378] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:10 2022] GET /identity/v3/projects/b0c58200470045b79a04ba5897774f1b => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:10.869530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbe551-a34f-452d-a9a6-14ef41f93122 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:10.887649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:10.950655 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 195/379] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:10.951577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55985cb4-210f-420c-aa75-310a882e53f4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:11.025856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbe551-a34f-452d-a9a6-14ef41f93122 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:11.081422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc31fd-808a-49ad-bea9-ed98b6930c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:11.081962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc31fd-808a-49ad-bea9-ed98b6930c8c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:11.082273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc31fd-808a-49ad-bea9-ed98b6930c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:11.082804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc31fd-808a-49ad-bea9-ed98b6930c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:11.083548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc31fd-808a-49ad-bea9-ed98b6930c8c None admin] RBAC: Adding query filter params (group.id=15828c4c01ee494e825fff221fb4f49e, role.id=924c0aaeca9d4fa6924529f3f93a2f7e, scope.project.id=caad43ce957444119e369cbd62b3b9fe) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:11.083858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc31fd-808a-49ad-bea9-ed98b6930c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:11.085297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc31fd-808a-49ad-bea9-ed98b6930c8c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:11.091185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 185/380] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 19 15:09:10 2022] GET /identity/v3/role_assignments?group.id=15828c4c01ee494e825fff221fb4f49e&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=924c0aaeca9d4fa6924529f3f93a2f7e => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:11.127225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55985cb4-210f-420c-aa75-310a882e53f4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:11.187299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516c0be-d1c0-41e6-ba1d-3d059df6b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:11.187956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516c0be-d1c0-41e6-ba1d-3d059df6b876 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:11.188230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516c0be-d1c0-41e6-ba1d-3d059df6b876 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:11.188497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516c0be-d1c0-41e6-ba1d-3d059df6b876 None admin] PATH_INFO: `/v3/groups/7e54b5542b46437687f91503a598aebb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:11.196495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:11.200420 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516c0be-d1c0-41e6-ba1d-3d059df6b876 None admin] RBAC: Authorizing `identity:get_group(group_id=7e54b5542b46437687f91503a598aebb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:11.202172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516c0be-d1c0-41e6-ba1d-3d059df6b876 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:11.204559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 196/381] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:10 2022] GET /identity/v3/groups/7e54b5542b46437687f91503a598aebb => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:11.210153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc31fd-808a-49ad-bea9-ed98b6930c8c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:11.311394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516c0be-d1c0-41e6-ba1d-3d059df6b876 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:11.317224 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:11.342014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc31fd-808a-49ad-bea9-ed98b6930c8c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:11.376962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea4812-05f8-417c-9a13-f742658407a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:11.377575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea4812-05f8-417c-9a13-f742658407a4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:11.377857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea4812-05f8-417c-9a13-f742658407a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:11.378160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea4812-05f8-417c-9a13-f742658407a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:11.379138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea4812-05f8-417c-9a13-f742658407a4 None admin] RBAC: Adding query filter params (group.id=7e54b5542b46437687f91503a598aebb, role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=b0c58200470045b79a04ba5897774f1b) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:11.379249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea4812-05f8-417c-9a13-f742658407a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:11.380623 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea4812-05f8-417c-9a13-f742658407a4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:11.386666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 186/382] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 19 15:09:11 2022] GET /identity/v3/role_assignments?group.id=7e54b5542b46437687f91503a598aebb&scope.project.id=b0c58200470045b79a04ba5897774f1b&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:11.436567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516c0be-d1c0-41e6-ba1d-3d059df6b876 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:11.475429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca0aa1-72c0-4101-8851-127d1fb924e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:11.476634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca0aa1-72c0-4101-8851-127d1fb924e3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:11.477143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca0aa1-72c0-4101-8851-127d1fb924e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:11.477618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca0aa1-72c0-4101-8851-127d1fb924e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:11.490968 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca0aa1-72c0-4101-8851-127d1fb924e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-62ca0aa1-72c0-4101-8851-127d1fb924e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:11.496842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:11.497745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:11.498562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:11.500966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 197/383] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:11.507247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea4812-05f8-417c-9a13-f742658407a4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:11.577610 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61545633-f850-4ab0-ad5a-3c2e9fcf604c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:11.577943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61545633-f850-4ab0-ad5a-3c2e9fcf604c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:11.578239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61545633-f850-4ab0-ad5a-3c2e9fcf604c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:11.579742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 198/384] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:11.585764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a629ca-3b71-4a58-a66c-24986645ffa3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:11.586317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a629ca-3b71-4a58-a66c-24986645ffa3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:11.586835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a629ca-3b71-4a58-a66c-24986645ffa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:11.612985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-73a629ca-3b71-4a58-a66c-24986645ffa3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:11.614659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-73a629ca-3b71-4a58-a66c-24986645ffa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:11.633756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea4812-05f8-417c-9a13-f742658407a4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:11.679699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52b820-9e8b-437a-8346-e489d3286f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:11.680884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52b820-9e8b-437a-8346-e489d3286f0a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:11.681185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52b820-9e8b-437a-8346-e489d3286f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:11.681464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52b820-9e8b-437a-8346-e489d3286f0a None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:11.682181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52b820-9e8b-437a-8346-e489d3286f0a None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:11.682493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52b820-9e8b-437a-8346-e489d3286f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:11.685264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52b820-9e8b-437a-8346-e489d3286f0a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:11.686872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:11.698548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 187/385] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:11.704468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52b820-9e8b-437a-8346-e489d3286f0a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:11.707594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:11.707965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 199/386] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:09:11.812568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52b820-9e8b-437a-8346-e489d3286f0a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:11.849058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b156b7-515d-4a66-a176-c8ec55ef7e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:11.849702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b156b7-515d-4a66-a176-c8ec55ef7e3e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:11.850088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b156b7-515d-4a66-a176-c8ec55ef7e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:11.850275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b156b7-515d-4a66-a176-c8ec55ef7e3e None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:11.851417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b156b7-515d-4a66-a176-c8ec55ef7e3e None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:11.852924 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b156b7-515d-4a66-a176-c8ec55ef7e3e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:11.854976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 188/387] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:11 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:11.860421 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a629ca-3b71-4a58-a66c-24986645ffa3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:11.970482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a629ca-3b71-4a58-a66c-24986645ffa3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:12.009583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee10ce-0c0a-4edb-bc41-7dbfa2ed2607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:12.010264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee10ce-0c0a-4edb-bc41-7dbfa2ed2607 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:12.010546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee10ce-0c0a-4edb-bc41-7dbfa2ed2607 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:12.010826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee10ce-0c0a-4edb-bc41-7dbfa2ed2607 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:12.011982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee10ce-0c0a-4edb-bc41-7dbfa2ed2607 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:12.013989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee10ce-0c0a-4edb-bc41-7dbfa2ed2607 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:12.015684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b156b7-515d-4a66-a176-c8ec55ef7e3e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:12.015903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 200/388] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:11 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:12.022363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee10ce-0c0a-4edb-bc41-7dbfa2ed2607 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:12.100014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:12.109199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:12.150156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b156b7-515d-4a66-a176-c8ec55ef7e3e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:12.160054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee10ce-0c0a-4edb-bc41-7dbfa2ed2607 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:12.198742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16448641-80e2-484a-942b-3c9cf9102230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:12.199398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16448641-80e2-484a-942b-3c9cf9102230 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:12.199680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16448641-80e2-484a-942b-3c9cf9102230 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:12.199956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16448641-80e2-484a-942b-3c9cf9102230 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:12.213706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16448641-80e2-484a-942b-3c9cf9102230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-16448641-80e2-484a-942b-3c9cf9102230 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:12.219454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:12.220336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:12.221175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 189/389] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:09:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:12.222822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20201fd1-1553-463a-9410-68e93afe39d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:12.223523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20201fd1-1553-463a-9410-68e93afe39d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:12.223803 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20201fd1-1553-463a-9410-68e93afe39d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:12.224077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20201fd1-1553-463a-9410-68e93afe39d7 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/groups/15828c4c01ee494e825fff221fb4f49e/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:12.231154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20201fd1-1553-463a-9410-68e93afe39d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4b53680965d437990ee6e4f6a6dbc57, group_id=15828c4c01ee494e825fff221fb4f49e, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:12.232720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20201fd1-1553-463a-9410-68e93afe39d7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:12.240277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16448641-80e2-484a-942b-3c9cf9102230 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:12.259224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 201/390] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 19 15:09:12 2022] PUT /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/groups/15828c4c01ee494e825fff221fb4f49e/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:09:12.366316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16448641-80e2-484a-942b-3c9cf9102230 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:12.399423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:12.406854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c587307-134c-4009-b6e7-48b17f23364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:12.407716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c587307-134c-4009-b6e7-48b17f23364c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:12.408113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c587307-134c-4009-b6e7-48b17f23364c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:12.408402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c587307-134c-4009-b6e7-48b17f23364c None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:12.409200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c587307-134c-4009-b6e7-48b17f23364c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:12.409517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c587307-134c-4009-b6e7-48b17f23364c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:12.410949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c587307-134c-4009-b6e7-48b17f23364c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:12.421016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 190/391] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:12.426923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20201fd1-1553-463a-9410-68e93afe39d7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:12.553311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20201fd1-1553-463a-9410-68e93afe39d7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:12.575535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:12.595323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd946-b9a1-4124-885c-f1d780573dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:12.596254 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd946-b9a1-4124-885c-f1d780573dcf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:12.596719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd946-b9a1-4124-885c-f1d780573dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:12.597171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dd946-b9a1-4124-885c-f1d780573dcf None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:12.598527 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd946-b9a1-4124-885c-f1d780573dcf None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:12.600265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dd946-b9a1-4124-885c-f1d780573dcf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:12.602437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 202/392] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:12 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:12.611361 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c587307-134c-4009-b6e7-48b17f23364c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:12.727688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c587307-134c-4009-b6e7-48b17f23364c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:12.772102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d2b86-c532-408b-a466-d03f3c7975cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:12.773078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2b86-c532-408b-a466-d03f3c7975cd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:12.773538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2b86-c532-408b-a466-d03f3c7975cd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:12.773981 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2b86-c532-408b-a466-d03f3c7975cd None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:12.775429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d2b86-c532-408b-a466-d03f3c7975cd None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:12.777130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d2b86-c532-408b-a466-d03f3c7975cd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:12.779630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 191/393] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:12 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:12.785491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd946-b9a1-4124-885c-f1d780573dcf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:12.909831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dd946-b9a1-4124-885c-f1d780573dcf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:12.955642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eee71b-e40e-4a9b-b62a-52aa93ce7928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:12.956707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee71b-e40e-4a9b-b62a-52aa93ce7928 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:12.957170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee71b-e40e-4a9b-b62a-52aa93ce7928 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:12.957624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eee71b-e40e-4a9b-b62a-52aa93ce7928 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/groups/15828c4c01ee494e825fff221fb4f49e/roles/924c0aaeca9d4fa6924529f3f93a2f7e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:12.960072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eee71b-e40e-4a9b-b62a-52aa93ce7928 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4b53680965d437990ee6e4f6a6dbc57, group_id=15828c4c01ee494e825fff221fb4f49e, role_id=924c0aaeca9d4fa6924529f3f93a2f7e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:12.961702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eee71b-e40e-4a9b-b62a-52aa93ce7928 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:12.995598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 203/394] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 19 15:09:12 2022] PUT /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57/groups/15828c4c01ee494e825fff221fb4f49e/roles/924c0aaeca9d4fa6924529f3f93a2f7e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:09:13.227661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619a736-436d-4304-84e9-7241ca851851 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:13.228321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619a736-436d-4304-84e9-7241ca851851 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:13.228878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619a736-436d-4304-84e9-7241ca851851 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:13.231111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 192/395] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:13.237024 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35445f-908d-46b6-b3af-a32ef40052ca None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:13.237956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35445f-908d-46b6-b3af-a32ef40052ca None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:13.238464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35445f-908d-46b6-b3af-a32ef40052ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:13.259372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eb35445f-908d-46b6-b3af-a32ef40052ca None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:13.260923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eb35445f-908d-46b6-b3af-a32ef40052ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:13.311656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:13.342491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 204/396] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:13.640352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619a736-436d-4304-84e9-7241ca851851 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:13.709889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d5ec0-2a74-4276-b4d9-8d0b0cb828cb None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:13.710881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d5ec0-2a74-4276-b4d9-8d0b0cb828cb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:13.711273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d5ec0-2a74-4276-b4d9-8d0b0cb828cb None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:13.713014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 205/397] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:09:13.718948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb755-824f-4144-9c1b-3ef8ebf02bf7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:13.719462 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb755-824f-4144-9c1b-3ef8ebf02bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:13.719883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bb755-824f-4144-9c1b-3ef8ebf02bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:13.724565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:13.748176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8b7bb755-824f-4144-9c1b-3ef8ebf02bf7 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:13.755087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8b7bb755-824f-4144-9c1b-3ef8ebf02bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:13.803714 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619a736-436d-4304-84e9-7241ca851851 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:13.869073 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09301a-924c-4cd6-bd29-07cc24502b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:13.869922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09301a-924c-4cd6-bd29-07cc24502b78 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:13.870334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09301a-924c-4cd6-bd29-07cc24502b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:13.870872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09301a-924c-4cd6-bd29-07cc24502b78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:13.872993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 206/398] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:13.884426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09301a-924c-4cd6-bd29-07cc24502b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8b09301a-924c-4cd6-bd29-07cc24502b78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:13.890402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:13.891582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:13.892388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:13.893279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 193/399] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:13.898934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bb755-824f-4144-9c1b-3ef8ebf02bf7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:14.052824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bb755-824f-4144-9c1b-3ef8ebf02bf7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:14.061109 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:14.094522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94c030-22d7-4e65-9cdd-233842a4db08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:14.095143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c030-22d7-4e65-9cdd-233842a4db08 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:14.095425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c030-22d7-4e65-9cdd-233842a4db08 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:14.095696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c030-22d7-4e65-9cdd-233842a4db08 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:14.096369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94c030-22d7-4e65-9cdd-233842a4db08 None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:14.096673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94c030-22d7-4e65-9cdd-233842a4db08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:14.098052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94c030-22d7-4e65-9cdd-233842a4db08 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:14.110175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 207/400] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:14.115879 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09301a-924c-4cd6-bd29-07cc24502b78 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:14.262169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09301a-924c-4cd6-bd29-07cc24502b78 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:14.280556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94c030-22d7-4e65-9cdd-233842a4db08 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:14.290681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:14.315604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b64eb-70fe-4627-bd4b-1b3c82f23e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:14.316158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b64eb-70fe-4627-bd4b-1b3c82f23e03 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:14.316433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b64eb-70fe-4627-bd4b-1b3c82f23e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:14.316706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b64eb-70fe-4627-bd4b-1b3c82f23e03 None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:14.317939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b64eb-70fe-4627-bd4b-1b3c82f23e03 None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:14.319514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b64eb-70fe-4627-bd4b-1b3c82f23e03 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:14.321317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 194/401] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:14 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:14.327875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b64eb-70fe-4627-bd4b-1b3c82f23e03 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:14.431369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94c030-22d7-4e65-9cdd-233842a4db08 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:14.455874 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b64eb-70fe-4627-bd4b-1b3c82f23e03 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:14.475937 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd95e7-d051-4723-a741-1d4d7030ebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:14.476584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd95e7-d051-4723-a741-1d4d7030ebd9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:14.477389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd95e7-d051-4723-a741-1d4d7030ebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:14.477682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd95e7-d051-4723-a741-1d4d7030ebd9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:14.492422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee558a0-b424-4f03-a755-726b55a15af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:14.492617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd95e7-d051-4723-a741-1d4d7030ebd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:14.493052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee558a0-b424-4f03-a755-726b55a15af8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:14.493328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee558a0-b424-4f03-a755-726b55a15af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:14.493657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee558a0-b424-4f03-a755-726b55a15af8 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:14.494825 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee558a0-b424-4f03-a755-726b55a15af8 None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:14.496262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee558a0-b424-4f03-a755-726b55a15af8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-07cd95e7-d051-4723-a741-1d4d7030ebd9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:14.497912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:14.499246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:14.500028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:14.500617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 195/402] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:14 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:14.500617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dca98-5003-45df-82da-0c263599a423 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:14.500617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dca98-5003-45df-82da-0c263599a423 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:14.500617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dca98-5003-45df-82da-0c263599a423 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:14.502482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 196/403] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:14.504213 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 208/404] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:09:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:14.505467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dca98-5003-45df-82da-0c263599a423 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:14.510167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd95e7-d051-4723-a741-1d4d7030ebd9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:14.546430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:14.592942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:14.629586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd95e7-d051-4723-a741-1d4d7030ebd9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:14.646166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dca98-5003-45df-82da-0c263599a423 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:14.666404 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aac856-891c-4129-add4-d9339e8dd59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:14.667036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aac856-891c-4129-add4-d9339e8dd59b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:14.667311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aac856-891c-4129-add4-d9339e8dd59b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:14.667576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aac856-891c-4129-add4-d9339e8dd59b None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:14.668292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aac856-891c-4129-add4-d9339e8dd59b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:14.668529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aac856-891c-4129-add4-d9339e8dd59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:14.670677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aac856-891c-4129-add4-d9339e8dd59b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:14.679957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 209/405] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:14.681140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077f9a-0f93-460c-b10e-af2fd22f1233 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:14.681425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077f9a-0f93-460c-b10e-af2fd22f1233 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:14.681739 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11077f9a-0f93-460c-b10e-af2fd22f1233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:14.696717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e6b6c-a3ce-4c0c-8f29-f1b2bf95b09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:14.697771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e6b6c-a3ce-4c0c-8f29-f1b2bf95b09b None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:14.698314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e6b6c-a3ce-4c0c-8f29-f1b2bf95b09b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:14.698768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e6b6c-a3ce-4c0c-8f29-f1b2bf95b09b None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe/groups/15828c4c01ee494e825fff221fb4f49e/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:14.701287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-11077f9a-0f93-460c-b10e-af2fd22f1233 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:14.701678 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e6b6c-a3ce-4c0c-8f29-f1b2bf95b09b None admin] RBAC: Authorizing `identity:create_grant(project_id=caad43ce957444119e369cbd62b3b9fe, group_id=15828c4c01ee494e825fff221fb4f49e, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:14.702635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-11077f9a-0f93-460c-b10e-af2fd22f1233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:14.703725 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e6b6c-a3ce-4c0c-8f29-f1b2bf95b09b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:14.725936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 197/406] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 19 15:09:14 2022] PUT /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe/groups/15828c4c01ee494e825fff221fb4f49e/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:09:14.727168 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e6b6c-a3ce-4c0c-8f29-f1b2bf95b09b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:14.788247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 210/407] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:14.813009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c249ccf-50a1-4be6-b68a-8cd68b53722a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:14.813304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c249ccf-50a1-4be6-b68a-8cd68b53722a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:14.813717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c249ccf-50a1-4be6-b68a-8cd68b53722a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:14.815494 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 211/408] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:14.822064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4f0c-5848-4082-b080-2d58d634203e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:14.822370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4f0c-5848-4082-b080-2d58d634203e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:14.822648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a4f0c-5848-4082-b080-2d58d634203e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:14.863332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-153a4f0c-5848-4082-b080-2d58d634203e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:14.865092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-153a4f0c-5848-4082-b080-2d58d634203e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:14.867583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e6b6c-a3ce-4c0c-8f29-f1b2bf95b09b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:14.885069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:14.891870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:14.917554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7becf48-5064-4cc2-a4db-2b4cba21242d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:14.919524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7becf48-5064-4cc2-a4db-2b4cba21242d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:14.919989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7becf48-5064-4cc2-a4db-2b4cba21242d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:14.920437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7becf48-5064-4cc2-a4db-2b4cba21242d None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:14.922598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7becf48-5064-4cc2-a4db-2b4cba21242d None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:14.924244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7becf48-5064-4cc2-a4db-2b4cba21242d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:14.926901 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 198/409] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:14 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:14.934393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7becf48-5064-4cc2-a4db-2b4cba21242d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:14.968259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 212/410] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:15.088794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7becf48-5064-4cc2-a4db-2b4cba21242d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:15.142849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25af7f-4b3a-43f7-a221-6bbfd36611b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:15.143408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25af7f-4b3a-43f7-a221-6bbfd36611b5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:15.143684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25af7f-4b3a-43f7-a221-6bbfd36611b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:15.143951 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25af7f-4b3a-43f7-a221-6bbfd36611b5 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:15.145139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25af7f-4b3a-43f7-a221-6bbfd36611b5 None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:15.146605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25af7f-4b3a-43f7-a221-6bbfd36611b5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:15.148539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 199/411] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:14 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:15.154013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a4f0c-5848-4082-b080-2d58d634203e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:15.193026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25af7f-4b3a-43f7-a221-6bbfd36611b5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:15.285094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a4f0c-5848-4082-b080-2d58d634203e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:15.317293 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:15.323896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd428b2-b884-4188-95d0-062a0cd8e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:15.324911 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd428b2-b884-4188-95d0-062a0cd8e9d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:15.325898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd428b2-b884-4188-95d0-062a0cd8e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:15.326342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd428b2-b884-4188-95d0-062a0cd8e9d6 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe/groups/15828c4c01ee494e825fff221fb4f49e/roles/924c0aaeca9d4fa6924529f3f93a2f7e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:15.328844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd428b2-b884-4188-95d0-062a0cd8e9d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=caad43ce957444119e369cbd62b3b9fe, group_id=15828c4c01ee494e825fff221fb4f49e, role_id=924c0aaeca9d4fa6924529f3f93a2f7e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:15.330478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd428b2-b884-4188-95d0-062a0cd8e9d6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:15.347364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 213/412] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 19 15:09:15 2022] PUT /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe/groups/15828c4c01ee494e825fff221fb4f49e/roles/924c0aaeca9d4fa6924529f3f93a2f7e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:09:15.348617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd428b2-b884-4188-95d0-062a0cd8e9d6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:15.378423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:15.393866 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25af7f-4b3a-43f7-a221-6bbfd36611b5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:15.437025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3005-7968-4816-ab0b-083660d3c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:15.438337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3005-7968-4816-ab0b-083660d3c83f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:15.438877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3005-7968-4816-ab0b-083660d3c83f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:15.439426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3005-7968-4816-ab0b-083660d3c83f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:15.453560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db3005-7968-4816-ab0b-083660d3c83f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-77db3005-7968-4816-ab0b-083660d3c83f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:15.459858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:15.461063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:15.462112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:15.464856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 200/413] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:15.471060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3005-7968-4816-ab0b-083660d3c83f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:15.573291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd428b2-b884-4188-95d0-062a0cd8e9d6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:15.610139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3005-7968-4816-ab0b-083660d3c83f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:15.617703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4de553-1e01-43c4-85c9-dbc599bb2c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:15.618374 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4de553-1e01-43c4-85c9-dbc599bb2c6d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:15.618657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4de553-1e01-43c4-85c9-dbc599bb2c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:15.618931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4de553-1e01-43c4-85c9-dbc599bb2c6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:15.625816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:15.633988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4de553-1e01-43c4-85c9-dbc599bb2c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ba4de553-1e01-43c4-85c9-dbc599bb2c6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:15.642459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:15.643350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:15.644753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 214/414] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:15.645417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c39dda-1fbb-43d8-8578-5a1309315c32 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:15.645417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c39dda-1fbb-43d8-8578-5a1309315c32 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:15.645733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c39dda-1fbb-43d8-8578-5a1309315c32 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:15.647365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 215/415] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:15.651921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c39dda-1fbb-43d8-8578-5a1309315c32 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:15.657394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9669ebe-bc46-4657-8aab-6d5395d9f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:15.658687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9669ebe-bc46-4657-8aab-6d5395d9f70f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:15.659170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9669ebe-bc46-4657-8aab-6d5395d9f70f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:15.659703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9669ebe-bc46-4657-8aab-6d5395d9f70f None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:15.660634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9669ebe-bc46-4657-8aab-6d5395d9f70f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:15.661233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9669ebe-bc46-4657-8aab-6d5395d9f70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:15.662834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9669ebe-bc46-4657-8aab-6d5395d9f70f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:15.673003 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 201/416] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:15.674724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5cb0b-b0cd-4ceb-8e7c-3cf9c98f271b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:15.675216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5cb0b-b0cd-4ceb-8e7c-3cf9c98f271b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:15.675739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5cb0b-b0cd-4ceb-8e7c-3cf9c98f271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:15.696438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e3b5cb0b-b0cd-4ceb-8e7c-3cf9c98f271b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:15.698018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e3b5cb0b-b0cd-4ceb-8e7c-3cf9c98f271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:15.724945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:15.757835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c39dda-1fbb-43d8-8578-5a1309315c32 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:15.777506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 202/417] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:15.779286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5cb0b-b0cd-4ceb-8e7c-3cf9c98f271b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:15.813555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bb70a-219b-4dd8-9fa9-e99cdcfa55bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:15.814132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb70a-219b-4dd8-9fa9-e99cdcfa55bb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:15.814422 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb70a-219b-4dd8-9fa9-e99cdcfa55bb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:15.814689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb70a-219b-4dd8-9fa9-e99cdcfa55bb None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:15.815360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bb70a-219b-4dd8-9fa9-e99cdcfa55bb None admin] RBAC: Adding query filter params (name=member) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:15.815668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bb70a-219b-4dd8-9fa9-e99cdcfa55bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:15.817040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bb70a-219b-4dd8-9fa9-e99cdcfa55bb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:15.833558 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 216/418] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:15.838555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bb70a-219b-4dd8-9fa9-e99cdcfa55bb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:15.890838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5cb0b-b0cd-4ceb-8e7c-3cf9c98f271b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:15.894353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:15.926946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb41c2-0312-4840-ac61-7916aaaf83bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:15.927897 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb41c2-0312-4840-ac61-7916aaaf83bb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:15.928377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb41c2-0312-4840-ac61-7916aaaf83bb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:15.928846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb41c2-0312-4840-ac61-7916aaaf83bb None admin] PATH_INFO: `/v3/groups/7e54b5542b46437687f91503a598aebb` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:15.930467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb41c2-0312-4840-ac61-7916aaaf83bb None admin] RBAC: Authorizing `identity:get_group(group_id=7e54b5542b46437687f91503a598aebb)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:15.932144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb41c2-0312-4840-ac61-7916aaaf83bb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:15.938401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 203/419] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:15 2022] GET /identity/v3/groups/7e54b5542b46437687f91503a598aebb => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:15.940599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb41c2-0312-4840-ac61-7916aaaf83bb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:15.955872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bb70a-219b-4dd8-9fa9-e99cdcfa55bb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:15.988520 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:15.990918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d594d6-8ac6-4773-a7be-2cd6d6bba1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:15.991533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d594d6-8ac6-4773-a7be-2cd6d6bba1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:15.991818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d594d6-8ac6-4773-a7be-2cd6d6bba1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:15.992096 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d594d6-8ac6-4773-a7be-2cd6d6bba1f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:16.048390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb41c2-0312-4840-ac61-7916aaaf83bb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:16.068440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d594d6-8ac6-4773-a7be-2cd6d6bba1f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:16.070294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d594d6-8ac6-4773-a7be-2cd6d6bba1f2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:16.084951 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5ab57-c7ff-484a-b5e4-f839333df4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:16.085863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5ab57-c7ff-484a-b5e4-f839333df4ef None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:16.086397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5ab57-c7ff-484a-b5e4-f839333df4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:16.086864 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5ab57-c7ff-484a-b5e4-f839333df4ef None admin] PATH_INFO: `/v3/projects/b0c58200470045b79a04ba5897774f1b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:16.088210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5ab57-c7ff-484a-b5e4-f839333df4ef None admin] RBAC: Authorizing `identity:get_project(project_id=b0c58200470045b79a04ba5897774f1b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:16.089843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5ab57-c7ff-484a-b5e4-f839333df4ef None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:16.096552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 204/420] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:15 2022] GET /identity/v3/projects/b0c58200470045b79a04ba5897774f1b => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:16.097951 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5ab57-c7ff-484a-b5e4-f839333df4ef None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:16.141917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:16.177974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 217/421] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:16.187249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d594d6-8ac6-4773-a7be-2cd6d6bba1f2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:16.203882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5ab57-c7ff-484a-b5e4-f839333df4ef None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:16.217669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:16.256961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221814e8-b32a-41e1-82bd-6edbf0a7aea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:16.258364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221814e8-b32a-41e1-82bd-6edbf0a7aea9 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:16.258830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221814e8-b32a-41e1-82bd-6edbf0a7aea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:16.259290 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221814e8-b32a-41e1-82bd-6edbf0a7aea9 None admin] PATH_INFO: `/v3/projects/b0c58200470045b79a04ba5897774f1b/groups/7e54b5542b46437687f91503a598aebb/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:16.262653 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221814e8-b32a-41e1-82bd-6edbf0a7aea9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0c58200470045b79a04ba5897774f1b, group_id=7e54b5542b46437687f91503a598aebb, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:16.264626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221814e8-b32a-41e1-82bd-6edbf0a7aea9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:16.279084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 205/422] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Aug 19 15:09:16 2022] PUT /identity/v3/projects/b0c58200470045b79a04ba5897774f1b/groups/7e54b5542b46437687f91503a598aebb/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:09:16.280093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221814e8-b32a-41e1-82bd-6edbf0a7aea9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:16.300927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d594d6-8ac6-4773-a7be-2cd6d6bba1f2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:16.341732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dc298-4d6e-4be7-9e1a-22a02fc2a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:16.342838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc298-4d6e-4be7-9e1a-22a02fc2a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:16.343380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc298-4d6e-4be7-9e1a-22a02fc2a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:16.344004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc298-4d6e-4be7-9e1a-22a02fc2a6b5 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:16.345434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dc298-4d6e-4be7-9e1a-22a02fc2a6b5 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:16.347598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dc298-4d6e-4be7-9e1a-22a02fc2a6b5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:16.349764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 218/423] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:16 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:16.355630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dc298-4d6e-4be7-9e1a-22a02fc2a6b5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:16.391605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:16.395189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221814e8-b32a-41e1-82bd-6edbf0a7aea9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:16.437483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611241cc-56a4-4e84-8ece-313ca595aeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:16.437944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611241cc-56a4-4e84-8ece-313ca595aeaa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:16.438247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611241cc-56a4-4e84-8ece-313ca595aeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:16.438524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611241cc-56a4-4e84-8ece-313ca595aeaa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:16.449890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611241cc-56a4-4e84-8ece-313ca595aeaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-611241cc-56a4-4e84-8ece-313ca595aeaa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:16.455280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:16.456240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:16.457041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 206/424] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:09:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:16.462597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611241cc-56a4-4e84-8ece-313ca595aeaa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:16.486160 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:16.492025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dc298-4d6e-4be7-9e1a-22a02fc2a6b5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:16.531949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74047586-e1c5-405f-a858-7f52788d812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:16.533198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74047586-e1c5-405f-a858-7f52788d812c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:16.533686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74047586-e1c5-405f-a858-7f52788d812c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:16.534232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74047586-e1c5-405f-a858-7f52788d812c None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:16.535838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74047586-e1c5-405f-a858-7f52788d812c None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:16.537734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74047586-e1c5-405f-a858-7f52788d812c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:16.540062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 219/425] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:16 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:16.547178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74047586-e1c5-405f-a858-7f52788d812c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:16.596796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611241cc-56a4-4e84-8ece-313ca595aeaa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:16.634720 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7b26-c467-440a-a104-07810a0b3dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:16.635360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7b26-c467-440a-a104-07810a0b3dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:16.635839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7b26-c467-440a-a104-07810a0b3dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:16.636318 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7b26-c467-440a-a104-07810a0b3dc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:16.637401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb7b26-c467-440a-a104-07810a0b3dc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:16.637749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb7b26-c467-440a-a104-07810a0b3dc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:16.639688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb7b26-c467-440a-a104-07810a0b3dc8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:16.650830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 207/426] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:16.658587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7b26-c467-440a-a104-07810a0b3dc8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:16.669613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74047586-e1c5-405f-a858-7f52788d812c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:16.687713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:16.712434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2305bc-ccce-4e07-8cbc-406638bc0e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:16.713671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2305bc-ccce-4e07-8cbc-406638bc0e45 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:16.714410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2305bc-ccce-4e07-8cbc-406638bc0e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:16.715114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2305bc-ccce-4e07-8cbc-406638bc0e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:16.717011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2305bc-ccce-4e07-8cbc-406638bc0e45 None admin] RBAC: Adding query filter params (group.id=15828c4c01ee494e825fff221fb4f49e, role.id=e4dc6d4cfce94e67aa327307e8bd4190, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:16.717615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2305bc-ccce-4e07-8cbc-406638bc0e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:16.719487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2305bc-ccce-4e07-8cbc-406638bc0e45 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:16.727108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 220/427] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 19 15:09:16 2022] GET /identity/v3/role_assignments?group.id=15828c4c01ee494e825fff221fb4f49e&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:16.775476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7b26-c467-440a-a104-07810a0b3dc8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:16.819326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81faee15-b6a5-462f-8fec-a9d17bb1e2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:16.819954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faee15-b6a5-462f-8fec-a9d17bb1e2cd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:16.820235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faee15-b6a5-462f-8fec-a9d17bb1e2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:16.820511 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81faee15-b6a5-462f-8fec-a9d17bb1e2cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:16.896275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faee15-b6a5-462f-8fec-a9d17bb1e2cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:16.897859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81faee15-b6a5-462f-8fec-a9d17bb1e2cd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:16.928448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:17.003450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 208/428] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 15:09:17.009165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2305bc-ccce-4e07-8cbc-406638bc0e45 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:17.053516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:17.140613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2305bc-ccce-4e07-8cbc-406638bc0e45 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:17.173813 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5bac-5031-4c35-a816-8d1d35b07ae9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:17.174602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5bac-5031-4c35-a816-8d1d35b07ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:17.175096 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5bac-5031-4c35-a816-8d1d35b07ae9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:17.176924 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 209/429] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:17.182323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f51749-4483-4418-83f6-0122d6b92838 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:17.182867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f51749-4483-4418-83f6-0122d6b92838 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:17.182980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a8840-9f40-4ee5-b159-32428a1d88c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:17.183474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f51749-4483-4418-83f6-0122d6b92838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:17.183585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a8840-9f40-4ee5-b159-32428a1d88c5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:17.183854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a8840-9f40-4ee5-b159-32428a1d88c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:17.185176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a8840-9f40-4ee5-b159-32428a1d88c5 None admin] PATH_INFO: `/v3/projects/a4b53680965d437990ee6e4f6a6dbc57` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:17.185792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a8840-9f40-4ee5-b159-32428a1d88c5 None admin] RBAC: Authorizing `identity:get_project(project_id=a4b53680965d437990ee6e4f6a6dbc57)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:17.187374 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a8840-9f40-4ee5-b159-32428a1d88c5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:17.189241 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 221/430] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:17 2022] GET /identity/v3/projects/a4b53680965d437990ee6e4f6a6dbc57 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:17.194868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a8840-9f40-4ee5-b159-32428a1d88c5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:17.207439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c2f51749-4483-4418-83f6-0122d6b92838 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:17.208776 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c2f51749-4483-4418-83f6-0122d6b92838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:17.300268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 210/431] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:09:17.316406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:17.320760 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a8840-9f40-4ee5-b159-32428a1d88c5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:17.360220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02412240-49fb-49ad-bdb4-2f3c769e9df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:17.361232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02412240-49fb-49ad-bdb4-2f3c769e9df7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:17.361705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02412240-49fb-49ad-bdb4-2f3c769e9df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:17.362211 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02412240-49fb-49ad-bdb4-2f3c769e9df7 None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:17.363533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02412240-49fb-49ad-bdb4-2f3c769e9df7 None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:17.365184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02412240-49fb-49ad-bdb4-2f3c769e9df7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:17.367398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 222/432] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:17 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:17.373478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f51749-4483-4418-83f6-0122d6b92838 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:17.429199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:17.479907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f51749-4483-4418-83f6-0122d6b92838 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:17.514630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421719e-d38b-494b-a1e2-2ffb5cb3dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:17.515242 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421719e-d38b-494b-a1e2-2ffb5cb3dc6f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:17.515515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421719e-d38b-494b-a1e2-2ffb5cb3dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:17.515779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421719e-d38b-494b-a1e2-2ffb5cb3dc6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:17.516503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421719e-d38b-494b-a1e2-2ffb5cb3dc6f None admin] RBAC: Adding query filter params (group.id=15828c4c01ee494e825fff221fb4f49e, role.id=924c0aaeca9d4fa6924529f3f93a2f7e, scope.project.id=a4b53680965d437990ee6e4f6a6dbc57) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:17.516826 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421719e-d38b-494b-a1e2-2ffb5cb3dc6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:17.518245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421719e-d38b-494b-a1e2-2ffb5cb3dc6f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:17.524995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 211/433] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 19 15:09:17 2022] GET /identity/v3/role_assignments?group.id=15828c4c01ee494e825fff221fb4f49e&scope.project.id=a4b53680965d437990ee6e4f6a6dbc57&role.id=924c0aaeca9d4fa6924529f3f93a2f7e => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:17.639842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02412240-49fb-49ad-bdb4-2f3c769e9df7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:17.688375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa78d-51a7-4f92-a234-b1f95c090f94 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:17.688902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa78d-51a7-4f92-a234-b1f95c090f94 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:17.688902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afa78d-51a7-4f92-a234-b1f95c090f94 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:17.690382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 212/434] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:17.695255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffd405-aca3-4e26-83fd-f0cd6f7094cd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:17.695543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffd405-aca3-4e26-83fd-f0cd6f7094cd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:17.695814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffd405-aca3-4e26-83fd-f0cd6f7094cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:17.715853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-00ffd405-aca3-4e26-83fd-f0cd6f7094cd None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:17.717531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-00ffd405-aca3-4e26-83fd-f0cd6f7094cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:17.765291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02412240-49fb-49ad-bdb4-2f3c769e9df7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:17.801012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 213/435] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:09:17.809564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3f0e-5180-4875-ba65-e0ddd6915a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:17.810687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3f0e-5180-4875-ba65-e0ddd6915a2d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:17.810969 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3f0e-5180-4875-ba65-e0ddd6915a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:17.811244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc3f0e-5180-4875-ba65-e0ddd6915a2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:17.822220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc3f0e-5180-4875-ba65-e0ddd6915a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d6cc3f0e-5180-4875-ba65-e0ddd6915a2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:17.827397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:17.828317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:17.829547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 223/436] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:17.835816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffd405-aca3-4e26-83fd-f0cd6f7094cd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:17.884721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:17.941224 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffd405-aca3-4e26-83fd-f0cd6f7094cd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:17.976444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410e09d-c06d-41d8-aa0d-ed80deeed44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:17.977065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e09d-c06d-41d8-aa0d-ed80deeed44b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:17.977345 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e09d-c06d-41d8-aa0d-ed80deeed44b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:17.977637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e09d-c06d-41d8-aa0d-ed80deeed44b None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:17.978324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410e09d-c06d-41d8-aa0d-ed80deeed44b None admin] RBAC: Adding query filter params (name=member) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:17.978628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410e09d-c06d-41d8-aa0d-ed80deeed44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:17.980252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410e09d-c06d-41d8-aa0d-ed80deeed44b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:17.989803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 214/437] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:09:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:17.996227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3f0e-5180-4875-ba65-e0ddd6915a2d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:18.026436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:18.071589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410e09d-c06d-41d8-aa0d-ed80deeed44b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:18.103671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc3f0e-5180-4875-ba65-e0ddd6915a2d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:18.139466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fd1f9-5573-481a-a385-eca5ad2c3961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:18.140070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fd1f9-5573-481a-a385-eca5ad2c3961 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:18.140358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fd1f9-5573-481a-a385-eca5ad2c3961 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:18.140633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fd1f9-5573-481a-a385-eca5ad2c3961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:18.172083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410e09d-c06d-41d8-aa0d-ed80deeed44b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:18.184191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:18.211382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22136dcb-6629-48ad-a349-4d6db0158e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:18.212011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136dcb-6629-48ad-a349-4d6db0158e58 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:18.212298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136dcb-6629-48ad-a349-4d6db0158e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:18.212573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22136dcb-6629-48ad-a349-4d6db0158e58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:18.214634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fd1f9-5573-481a-a385-eca5ad2c3961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:18.216146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fd1f9-5573-481a-a385-eca5ad2c3961 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:18.222977 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22136dcb-6629-48ad-a349-4d6db0158e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-22136dcb-6629-48ad-a349-4d6db0158e58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:18.228166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:18.229022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:18.230136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 215/438] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:09:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:18.235830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22136dcb-6629-48ad-a349-4d6db0158e58 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:18.249186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:18.324296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 224/439] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:18.330217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fd1f9-5573-481a-a385-eca5ad2c3961 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:18.348332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22136dcb-6629-48ad-a349-4d6db0158e58 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:18.385000 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bf422-df10-4b1e-8655-1fd8f60b2480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:18.385713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bf422-df10-4b1e-8655-1fd8f60b2480 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:18.385988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bf422-df10-4b1e-8655-1fd8f60b2480 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:18.386289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bf422-df10-4b1e-8655-1fd8f60b2480 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:18.387068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bf422-df10-4b1e-8655-1fd8f60b2480 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:18.387372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bf422-df10-4b1e-8655-1fd8f60b2480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:18.389175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bf422-df10-4b1e-8655-1fd8f60b2480 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:18.401936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 216/440] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:18.402927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bf422-df10-4b1e-8655-1fd8f60b2480 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:18.430156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fd1f9-5573-481a-a385-eca5ad2c3961 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:18.435872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:18.457046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:18.465270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cfbe7-d846-422c-98f3-d8d5d3ee63be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:18.466476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cfbe7-d846-422c-98f3-d8d5d3ee63be None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:18.466765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cfbe7-d846-422c-98f3-d8d5d3ee63be None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:18.467029 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cfbe7-d846-422c-98f3-d8d5d3ee63be None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:18.468141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cfbe7-d846-422c-98f3-d8d5d3ee63be None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:18.469866 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cfbe7-d846-422c-98f3-d8d5d3ee63be None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:18.471499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 225/441] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:18 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:18.476838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cfbe7-d846-422c-98f3-d8d5d3ee63be None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:18.515929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bf422-df10-4b1e-8655-1fd8f60b2480 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:18.554273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e2ec8-4b46-404f-b2f0-5dae780d1e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:18.554886 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e2ec8-4b46-404f-b2f0-5dae780d1e16 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:18.555167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e2ec8-4b46-404f-b2f0-5dae780d1e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:18.555440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e2ec8-4b46-404f-b2f0-5dae780d1e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:18.586961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cfbe7-d846-422c-98f3-d8d5d3ee63be None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:18.619793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a56d7b-7717-448a-910f-a0b3341a7c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:18.620418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56d7b-7717-448a-910f-a0b3341a7c41 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:18.620696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56d7b-7717-448a-910f-a0b3341a7c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:18.620975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56d7b-7717-448a-910f-a0b3341a7c41 None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:18.622137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a56d7b-7717-448a-910f-a0b3341a7c41 None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:18.623568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a56d7b-7717-448a-910f-a0b3341a7c41 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:18.624211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e2ec8-4b46-404f-b2f0-5dae780d1e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:18.625116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 226/442] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:18 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:18.625648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e2ec8-4b46-404f-b2f0-5dae780d1e16 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:18.626302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b849ab7-4bf6-4887-ac46-7ee1715bf21c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:18.626589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b849ab7-4bf6-4887-ac46-7ee1715bf21c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:18.626861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b849ab7-4bf6-4887-ac46-7ee1715bf21c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:18.630826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 227/443] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:18.630826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b849ab7-4bf6-4887-ac46-7ee1715bf21c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:18.657322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:18.694099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:18.725930 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 217/444] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 15:09:18.727194 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807fe7d-e93b-4a3a-a8e0-33f6d4cd9005 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:18.727480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807fe7d-e93b-4a3a-a8e0-33f6d4cd9005 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:18.727752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807fe7d-e93b-4a3a-a8e0-33f6d4cd9005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:18.737944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b849ab7-4bf6-4887-ac46-7ee1715bf21c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:18.745264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b807fe7d-e93b-4a3a-a8e0-33f6d4cd9005 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:18.746518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b807fe7d-e93b-4a3a-a8e0-33f6d4cd9005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:18.770769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dd23c-0bf0-4324-8006-3a1258e677a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:18.771368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd23c-0bf0-4324-8006-3a1258e677a8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:18.771708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd23c-0bf0-4324-8006-3a1258e677a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:18.771917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd23c-0bf0-4324-8006-3a1258e677a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:18.772635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dd23c-0bf0-4324-8006-3a1258e677a8 None admin] RBAC: Adding query filter params (group.id=15828c4c01ee494e825fff221fb4f49e, role.id=e4dc6d4cfce94e67aa327307e8bd4190, scope.project.id=caad43ce957444119e369cbd62b3b9fe) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:18.772941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dd23c-0bf0-4324-8006-3a1258e677a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:18.774519 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dd23c-0bf0-4324-8006-3a1258e677a8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:18.780063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 228/445] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 19 15:09:18 2022] GET /identity/v3/role_assignments?group.id=15828c4c01ee494e825fff221fb4f49e&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=e4dc6d4cfce94e67aa327307e8bd4190 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:18.780827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dd23c-0bf0-4324-8006-3a1258e677a8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:18.816312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 218/446] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:18.901245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dd23c-0bf0-4324-8006-3a1258e677a8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:18.930829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:18.939438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc88b0-38fc-4202-bb5b-c112e221cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:18.940071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc88b0-38fc-4202-bb5b-c112e221cee4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:18.940354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc88b0-38fc-4202-bb5b-c112e221cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:18.940636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc88b0-38fc-4202-bb5b-c112e221cee4 None admin] PATH_INFO: `/v3/projects/caad43ce957444119e369cbd62b3b9fe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:18.941772 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc88b0-38fc-4202-bb5b-c112e221cee4 None admin] RBAC: Authorizing `identity:get_project(project_id=caad43ce957444119e369cbd62b3b9fe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:18.943241 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc88b0-38fc-4202-bb5b-c112e221cee4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:18.944891 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 229/447] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:18 2022] GET /identity/v3/projects/caad43ce957444119e369cbd62b3b9fe => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:18.950933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807fe7d-e93b-4a3a-a8e0-33f6d4cd9005 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:19.011613 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:19.057649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807fe7d-e93b-4a3a-a8e0-33f6d4cd9005 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:19.083482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc88b0-38fc-4202-bb5b-c112e221cee4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:19.096077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734bddf-09f4-4fb6-ae11-a292d30cd5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:19.096717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734bddf-09f4-4fb6-ae11-a292d30cd5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:19.097002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734bddf-09f4-4fb6-ae11-a292d30cd5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:19.097275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734bddf-09f4-4fb6-ae11-a292d30cd5a2 None admin] PATH_INFO: `/v3/groups/15828c4c01ee494e825fff221fb4f49e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:19.098423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734bddf-09f4-4fb6-ae11-a292d30cd5a2 None admin] RBAC: Authorizing `identity:get_group(group_id=15828c4c01ee494e825fff221fb4f49e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:19.099858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734bddf-09f4-4fb6-ae11-a292d30cd5a2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:19.101586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 219/448] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:18 2022] GET /identity/v3/groups/15828c4c01ee494e825fff221fb4f49e => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:19.108037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734bddf-09f4-4fb6-ae11-a292d30cd5a2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:19.202617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc88b0-38fc-4202-bb5b-c112e221cee4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:19.210276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734bddf-09f4-4fb6-ae11-a292d30cd5a2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:19.235270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610548-b1f5-4d99-91cc-b414bf84f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:19.235907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610548-b1f5-4d99-91cc-b414bf84f94f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:19.236042 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:19.236179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610548-b1f5-4d99-91cc-b414bf84f94f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:19.236450 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb610548-b1f5-4d99-91cc-b414bf84f94f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:19.243823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158b96e-f733-47f5-a66d-aafcc8f1fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:19.244423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158b96e-f733-47f5-a66d-aafcc8f1fb21 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:19.244707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158b96e-f733-47f5-a66d-aafcc8f1fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:19.244983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158b96e-f733-47f5-a66d-aafcc8f1fb21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:19.245707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158b96e-f733-47f5-a66d-aafcc8f1fb21 None admin] RBAC: Adding query filter params (group.id=15828c4c01ee494e825fff221fb4f49e, role.id=924c0aaeca9d4fa6924529f3f93a2f7e, scope.project.id=caad43ce957444119e369cbd62b3b9fe) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:19.246019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158b96e-f733-47f5-a66d-aafcc8f1fb21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:19.246454 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb610548-b1f5-4d99-91cc-b414bf84f94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:19.247494 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158b96e-f733-47f5-a66d-aafcc8f1fb21 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-bb610548-b1f5-4d99-91cc-b414bf84f94f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:19.251647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:19.252683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:19.267080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 230/449] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:19.267782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 220/450] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 19 15:09:19 2022] GET /identity/v3/role_assignments?group.id=15828c4c01ee494e825fff221fb4f49e&scope.project.id=caad43ce957444119e369cbd62b3b9fe&role.id=924c0aaeca9d4fa6924529f3f93a2f7e => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:19.267866 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610548-b1f5-4d99-91cc-b414bf84f94f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:19.318189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:19.363696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb610548-b1f5-4d99-91cc-b414bf84f94f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:19.397880 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a960396-f924-40e4-bc0e-fb1ec08ceb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:19.398527 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a960396-f924-40e4-bc0e-fb1ec08ceb27 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:19.398804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a960396-f924-40e4-bc0e-fb1ec08ceb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:19.399441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a960396-f924-40e4-bc0e-fb1ec08ceb27 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:19.399738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a960396-f924-40e4-bc0e-fb1ec08ceb27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:19.400041 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a960396-f924-40e4-bc0e-fb1ec08ceb27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:19.401402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a960396-f924-40e4-bc0e-fb1ec08ceb27 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:19.410285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 231/451] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:19.415483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158b96e-f733-47f5-a66d-aafcc8f1fb21 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:19.517929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158b96e-f733-47f5-a66d-aafcc8f1fb21 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:19.555357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d0abe-d6d4-4b85-9730-0679763c3116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:19.555982 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0abe-d6d4-4b85-9730-0679763c3116 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:19.556263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0abe-d6d4-4b85-9730-0679763c3116 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:19.556536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d0abe-d6d4-4b85-9730-0679763c3116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:19.615347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:19.625618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d0abe-d6d4-4b85-9730-0679763c3116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:19.627116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d0abe-d6d4-4b85-9730-0679763c3116 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:19.721408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 221/452] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:19.727180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a960396-f924-40e4-bc0e-fb1ec08ceb27 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:19.822086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a960396-f924-40e4-bc0e-fb1ec08ceb27 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:19.838377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:19.854794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053c95-2dd0-427c-b600-53d6e3dafaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:19.855409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053c95-2dd0-427c-b600-53d6e3dafaaf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:19.855689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053c95-2dd0-427c-b600-53d6e3dafaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:19.855963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7053c95-2dd0-427c-b600-53d6e3dafaaf None admin] PATH_INFO: `/v3/projects/b0c58200470045b79a04ba5897774f1b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:19.857096 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7053c95-2dd0-427c-b600-53d6e3dafaaf None admin] RBAC: Authorizing `identity:get_project(project_id=b0c58200470045b79a04ba5897774f1b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:19.858563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7053c95-2dd0-427c-b600-53d6e3dafaaf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:19.860144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 232/453] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:09:19 2022] GET /identity/v3/projects/b0c58200470045b79a04ba5897774f1b => generated 344 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:19.865443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d0abe-d6d4-4b85-9730-0679763c3116 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:19.952102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:19.961077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d0abe-d6d4-4b85-9730-0679763c3116 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:19.993736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc2463-91a0-44fd-b5be-7218f9702c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:19.994371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc2463-91a0-44fd-b5be-7218f9702c7a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:19.994649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc2463-91a0-44fd-b5be-7218f9702c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:19.994919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc2463-91a0-44fd-b5be-7218f9702c7a None admin] PATH_INFO: `/v3/groups/7e54b5542b46437687f91503a598aebb` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:19.996003 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc2463-91a0-44fd-b5be-7218f9702c7a None admin] RBAC: Authorizing `identity:get_group(group_id=7e54b5542b46437687f91503a598aebb)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:19.997979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc2463-91a0-44fd-b5be-7218f9702c7a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:19.999526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 222/454] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Aug 19 15:09:19 2022] GET /identity/v3/groups/7e54b5542b46437687f91503a598aebb => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:20.005201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053c95-2dd0-427c-b600-53d6e3dafaaf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:20.099581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7053c95-2dd0-427c-b600-53d6e3dafaaf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:20.131900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9db46-31bb-4c16-add4-918ae58c2112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:20.132479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9db46-31bb-4c16-add4-918ae58c2112 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:20.132756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9db46-31bb-4c16-add4-918ae58c2112 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:20.133025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9db46-31bb-4c16-add4-918ae58c2112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:20.133736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9db46-31bb-4c16-add4-918ae58c2112 None admin] RBAC: Adding query filter params (group.id=7e54b5542b46437687f91503a598aebb, role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=b0c58200470045b79a04ba5897774f1b) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:20.134060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9db46-31bb-4c16-add4-918ae58c2112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:20.135470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9db46-31bb-4c16-add4-918ae58c2112 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:20.140915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 233/455] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Aug 19 15:09:20 2022] GET /identity/v3/role_assignments?group.id=7e54b5542b46437687f91503a598aebb&scope.project.id=b0c58200470045b79a04ba5897774f1b&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:22.611293 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bc281-9d60-407f-8a55-94c8bebe114a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:22.611819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bc281-9d60-407f-8a55-94c8bebe114a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:22.611819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bc281-9d60-407f-8a55-94c8bebe114a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:22.613460 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 223/456] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:22.619169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94758e-7584-4234-bdc2-6f48811723c9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:22.619841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94758e-7584-4234-bdc2-6f48811723c9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:22.619841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94758e-7584-4234-bdc2-6f48811723c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:22.643715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1b94758e-7584-4234-bdc2-6f48811723c9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:22.644914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1b94758e-7584-4234-bdc2-6f48811723c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:22.714198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:22.741915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a6da-e988-4c3b-af0b-d7f9087f050c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:22.742244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a6da-e988-4c3b-af0b-d7f9087f050c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:22.742628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 234/457] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:22.742758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729a6da-e988-4c3b-af0b-d7f9087f050c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:22.745105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 224/458] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:22.749571 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137df998-9578-4c7e-88d3-89bc729e6249 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:22.749906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137df998-9578-4c7e-88d3-89bc729e6249 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:22.750223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137df998-9578-4c7e-88d3-89bc729e6249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:22.775138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-137df998-9578-4c7e-88d3-89bc729e6249 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:22.776382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-137df998-9578-4c7e-88d3-89bc729e6249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:22.852515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23536a0-71ae-4419-83d4-e4400b3ba8b2 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:22.853101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23536a0-71ae-4419-83d4-e4400b3ba8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:22.853597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23536a0-71ae-4419-83d4-e4400b3ba8b2 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:22.857473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 225/459] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:22.864721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b168a-fa7e-47cc-900e-4215c87e5657 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:22.864721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b168a-fa7e-47cc-900e-4215c87e5657 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:22.864721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b168a-fa7e-47cc-900e-4215c87e5657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:22.871438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 235/460] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:22.891194 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-713b168a-fa7e-47cc-900e-4215c87e5657 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:22.892671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-713b168a-fa7e-47cc-900e-4215c87e5657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:22.988669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 226/461] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:09:23.080841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137df998-9578-4c7e-88d3-89bc729e6249 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:23.211699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b168a-fa7e-47cc-900e-4215c87e5657 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:23.214157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137df998-9578-4c7e-88d3-89bc729e6249 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:23.229070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:23.261499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09c581-2a33-47c9-98a3-31ee7b8e2df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:23.262159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09c581-2a33-47c9-98a3-31ee7b8e2df3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:23.263043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09c581-2a33-47c9-98a3-31ee7b8e2df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:23.263307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09c581-2a33-47c9-98a3-31ee7b8e2df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:23.276196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09c581-2a33-47c9-98a3-31ee7b8e2df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:23.277863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09c581-2a33-47c9-98a3-31ee7b8e2df3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ab09c581-2a33-47c9-98a3-31ee7b8e2df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:23.300278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:23.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:23.302139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:23.302139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:23.302139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:23.304170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 236/462] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:23.321928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09c581-2a33-47c9-98a3-31ee7b8e2df3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:23.350691 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b168a-fa7e-47cc-900e-4215c87e5657 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:23.362384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:23.386881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f2714-1ff3-4cd5-9302-7b9a48186689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:23.388193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f2714-1ff3-4cd5-9302-7b9a48186689 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:23.389487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f2714-1ff3-4cd5-9302-7b9a48186689 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:23.389849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f2714-1ff3-4cd5-9302-7b9a48186689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:23.400574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f2714-1ff3-4cd5-9302-7b9a48186689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:23.402124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f2714-1ff3-4cd5-9302-7b9a48186689 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-095f2714-1ff3-4cd5-9302-7b9a48186689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:23.417550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:23.418521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:23.419393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:23.419393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:23.419393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:23.421226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 227/463] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:23.426014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f2714-1ff3-4cd5-9302-7b9a48186689 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:23.435741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09c581-2a33-47c9-98a3-31ee7b8e2df3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:23.473901 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0326fc-eea2-4b71-bc81-d5f9c1909d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:23.474459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0326fc-eea2-4b71-bc81-d5f9c1909d13 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:23.474738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0326fc-eea2-4b71-bc81-d5f9c1909d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:23.475012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0326fc-eea2-4b71-bc81-d5f9c1909d13 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:23.475654 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0326fc-eea2-4b71-bc81-d5f9c1909d13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:23.475952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0326fc-eea2-4b71-bc81-d5f9c1909d13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:23.477324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0326fc-eea2-4b71-bc81-d5f9c1909d13 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:23.489508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 237/464] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:23.490560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51535a-5c23-40f7-be76-35bdad42acf4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:23.490833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51535a-5c23-40f7-be76-35bdad42acf4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:23.491108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51535a-5c23-40f7-be76-35bdad42acf4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:23.496100 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 238/465] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:23.496100 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51535a-5c23-40f7-be76-35bdad42acf4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:23.521669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:23.540001 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f2714-1ff3-4cd5-9302-7b9a48186689 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:23.580448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedffaa3-1d00-4079-9c41-7fdaf2a42040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:23.581078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedffaa3-1d00-4079-9c41-7fdaf2a42040 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:23.581353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedffaa3-1d00-4079-9c41-7fdaf2a42040 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:23.581621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedffaa3-1d00-4079-9c41-7fdaf2a42040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:23.594754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedffaa3-1d00-4079-9c41-7fdaf2a42040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:23.596637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedffaa3-1d00-4079-9c41-7fdaf2a42040 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:23.598578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:23.609975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51535a-5c23-40f7-be76-35bdad42acf4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-cedffaa3-1d00-4079-9c41-7fdaf2a42040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:23.615599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:23.616768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:23.617599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:23.617599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:23.617599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:23.617599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 228/466] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:23.617599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedffaa3-1d00-4079-9c41-7fdaf2a42040 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:23.646651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9f939-0fc8-41dd-a899-135ff1e1bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:23.647262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9f939-0fc8-41dd-a899-135ff1e1bb96 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:23.647547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9f939-0fc8-41dd-a899-135ff1e1bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:23.647822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9f939-0fc8-41dd-a899-135ff1e1bb96 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:23.648463 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9f939-0fc8-41dd-a899-135ff1e1bb96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:23.648765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9f939-0fc8-41dd-a899-135ff1e1bb96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:23.650172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9f939-0fc8-41dd-a899-135ff1e1bb96 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:23.661805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 239/467] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:23.663059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e6c3-b835-4d4d-a600-0117d0a3cc03 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:23.663351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e6c3-b835-4d4d-a600-0117d0a3cc03 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:23.663625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e6c3-b835-4d4d-a600-0117d0a3cc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:23.682383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6821e6c3-b835-4d4d-a600-0117d0a3cc03 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:23.683684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6821e6c3-b835-4d4d-a600-0117d0a3cc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:23.742684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedffaa3-1d00-4079-9c41-7fdaf2a42040 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:23.755968 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 240/468] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:23.756725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821e6c3-b835-4d4d-a600-0117d0a3cc03 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:23.771804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:23.778957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b93293-5560-4dec-9ff9-8052972fc565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:23.779568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b93293-5560-4dec-9ff9-8052972fc565 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:23.779851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b93293-5560-4dec-9ff9-8052972fc565 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:23.780125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b93293-5560-4dec-9ff9-8052972fc565 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:23.780772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b93293-5560-4dec-9ff9-8052972fc565 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:23.782251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b93293-5560-4dec-9ff9-8052972fc565 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:23.805029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 229/469] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:09:23 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:09:23.805813 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b93293-5560-4dec-9ff9-8052972fc565 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:23.886539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821e6c3-b835-4d4d-a600-0117d0a3cc03 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:23.887308 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:23.928574 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab7586-0f33-47ad-913f-423631029487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:23.929194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab7586-0f33-47ad-913f-423631029487 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:23.929673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab7586-0f33-47ad-913f-423631029487 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:23.929950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab7586-0f33-47ad-913f-423631029487 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:23.930680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab7586-0f33-47ad-913f-423631029487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:23.930998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab7586-0f33-47ad-913f-423631029487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:23.932440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab7586-0f33-47ad-913f-423631029487 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:23.947736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 241/470] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:23.952074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8453c8-b6b9-4d37-8bb1-a67a239cd021 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:23.952074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8453c8-b6b9-4d37-8bb1-a67a239cd021 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:23.952074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8453c8-b6b9-4d37-8bb1-a67a239cd021 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:23.952074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 242/471] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:23.952511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8453c8-b6b9-4d37-8bb1-a67a239cd021 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:23.967322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b93293-5560-4dec-9ff9-8052972fc565 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:24.013171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b1f3c-f111-40a8-a43b-d45cf209aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:24.014302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b1f3c-f111-40a8-a43b-d45cf209aa96 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:24.014593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b1f3c-f111-40a8-a43b-d45cf209aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:24.014870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b1f3c-f111-40a8-a43b-d45cf209aa96 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:24.015510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b1f3c-f111-40a8-a43b-d45cf209aa96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:24.016942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b1f3c-f111-40a8-a43b-d45cf209aa96 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:24.047229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 230/472] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:09:23 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:09:24.048040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:24.048458 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c251-fcdb-4c2f-9da5-5f2cd17130ce None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:24.049054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c251-fcdb-4c2f-9da5-5f2cd17130ce None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:24.049054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875c251-fcdb-4c2f-9da5-5f2cd17130ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:24.079423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2875c251-fcdb-4c2f-9da5-5f2cd17130ce None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:24.081175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2875c251-fcdb-4c2f-9da5-5f2cd17130ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:24.090109 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8453c8-b6b9-4d37-8bb1-a67a239cd021 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:24.134130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4db66-99e5-4fb9-b7d0-01aa21d86c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:24.134545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4db66-99e5-4fb9-b7d0-01aa21d86c06 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:24.134930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4db66-99e5-4fb9-b7d0-01aa21d86c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:24.135302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4db66-99e5-4fb9-b7d0-01aa21d86c06 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:24.136151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4db66-99e5-4fb9-b7d0-01aa21d86c06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:24.137842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4db66-99e5-4fb9-b7d0-01aa21d86c06 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:24.166707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 243/473] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:09:23 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:09:24.168212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4db66-99e5-4fb9-b7d0-01aa21d86c06 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:24.174191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 231/474] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:24.288755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4db66-99e5-4fb9-b7d0-01aa21d86c06 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:24.319233 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:24.328048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a91b0-7953-4f7d-b6e7-d3b3419ab8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:24.328707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a91b0-7953-4f7d-b6e7-d3b3419ab8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:24.329115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a91b0-7953-4f7d-b6e7-d3b3419ab8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:24.329687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a91b0-7953-4f7d-b6e7-d3b3419ab8d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:24.342744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a91b0-7953-4f7d-b6e7-d3b3419ab8d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:24.344312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a91b0-7953-4f7d-b6e7-d3b3419ab8d5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5b9a91b0-7953-4f7d-b6e7-d3b3419ab8d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:24.360541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:24.361464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:24.362334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:24.362334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:24.362334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:24.362334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 244/475] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:24.368667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875c251-fcdb-4c2f-9da5-5f2cd17130ce None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:24.413541 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:24.462623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a91b0-7953-4f7d-b6e7-d3b3419ab8d5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:24.495219 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875c251-fcdb-4c2f-9da5-5f2cd17130ce None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:24.542511 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1cc76-dae2-4870-b12f-d4d9577c0f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:24.543045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1cc76-dae2-4870-b12f-d4d9577c0f0a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:24.543324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1cc76-dae2-4870-b12f-d4d9577c0f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:24.543600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1cc76-dae2-4870-b12f-d4d9577c0f0a None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:24.544296 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1cc76-dae2-4870-b12f-d4d9577c0f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:24.544605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1cc76-dae2-4870-b12f-d4d9577c0f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:24.545975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1cc76-dae2-4870-b12f-d4d9577c0f0a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:24.560974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 232/476] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:24.566100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1cc76-dae2-4870-b12f-d4d9577c0f0a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:24.672405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a91b0-7953-4f7d-b6e7-d3b3419ab8d5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:24.678061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:24.682642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1cc76-dae2-4870-b12f-d4d9577c0f0a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:24.722090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41cbf-a056-417a-886b-f6faa8ce3d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:24.722715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41cbf-a056-417a-886b-f6faa8ce3d9f None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:24.729858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41cbf-a056-417a-886b-f6faa8ce3d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:24.729858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41cbf-a056-417a-886b-f6faa8ce3d9f None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:24.729858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41cbf-a056-417a-886b-f6faa8ce3d9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:24.729858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41cbf-a056-417a-886b-f6faa8ce3d9f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:24.742926 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8fe4b-8728-4d4b-a9cd-e2322a9565fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:24.743692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8fe4b-8728-4d4b-a9cd-e2322a9565fc None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:24.744084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8fe4b-8728-4d4b-a9cd-e2322a9565fc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:24.744419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8fe4b-8728-4d4b-a9cd-e2322a9565fc None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:24.745203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8fe4b-8728-4d4b-a9cd-e2322a9565fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:24.746752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8fe4b-8728-4d4b-a9cd-e2322a9565fc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:24.761143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 233/477] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:09:24 2022] POST /identity/v3/users => generated 249 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:09:24.762339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.sql.core [None req-81c8fe4b-8728-4d4b-a9cd-e2322a9565fc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 15:09:24.762339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 19 15:09:24.762339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [parameters: {'id': '7f08b5ed1ddf425ebf34008ae0a616f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 19 15:09:24.762339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81449) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-81c8fe4b-8728-4d4b-a9cd-e2322a9565fc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Aug 19 15:09:24.781997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return ref.to_dict() Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 15:09:24.783173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application yield resource Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise self.value Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application session.commit() Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 15:09:24.784796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.flush() Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application compat.raise_( Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 15:09:24.786351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 15:09:24.787690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 15:09:24.788515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [parameters: {'id': '7f08b5ed1ddf425ebf34008ae0a616f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:24.789287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 19 15:09:24.795347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:24.797408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 245/478] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 19 15:09:24 2022] POST /identity/v3/roles => generated 144 bytes in 322 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:24.797556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41cbf-a056-417a-886b-f6faa8ce3d9f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:24.927884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41cbf-a056-417a-886b-f6faa8ce3d9f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:24.967147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce650f3-b0dc-4ed8-b48a-7faba8808829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:24.967864 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce650f3-b0dc-4ed8-b48a-7faba8808829 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:24.968148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce650f3-b0dc-4ed8-b48a-7faba8808829 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:24.968423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce650f3-b0dc-4ed8-b48a-7faba8808829 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:24.979979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce650f3-b0dc-4ed8-b48a-7faba8808829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fce650f3-b0dc-4ed8-b48a-7faba8808829 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:24.985517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:24.987595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:24.989515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 234/479] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:09:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:24.993505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8fe4b-8728-4d4b-a9cd-e2322a9565fc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:25.053501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:25.131343 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8fe4b-8728-4d4b-a9cd-e2322a9565fc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:25.173946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88995079-a4bf-444c-be63-0a39f258cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:25.174603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995079-a4bf-444c-be63-0a39f258cd6a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:25.174886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995079-a4bf-444c-be63-0a39f258cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:25.175164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88995079-a4bf-444c-be63-0a39f258cd6a None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:25.175833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88995079-a4bf-444c-be63-0a39f258cd6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:25.176197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88995079-a4bf-444c-be63-0a39f258cd6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:25.177571 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88995079-a4bf-444c-be63-0a39f258cd6a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:25.190461 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 246/480] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:26.067184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdee5-ec20-4b96-bbbd-5eda0f3b9b16 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:26.067863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdee5-ec20-4b96-bbbd-5eda0f3b9b16 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:26.067863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecdee5-ec20-4b96-bbbd-5eda0f3b9b16 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:26.069401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 235/481] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:26.085698 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa99b77-5353-4771-8354-a380b1f6e3ff None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:26.086170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa99b77-5353-4771-8354-a380b1f6e3ff None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:26.086353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa99b77-5353-4771-8354-a380b1f6e3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:26.104865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2fa99b77-5353-4771-8354-a380b1f6e3ff None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:26.106092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2fa99b77-5353-4771-8354-a380b1f6e3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:26.192378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 247/482] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:26.605441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecdee5-ec20-4b96-bbbd-5eda0f3b9b16 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:26.616498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d67c9b-126d-42f2-9455-e1b628a00f4b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:26.616777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d67c9b-126d-42f2-9455-e1b628a00f4b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:26.617048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d67c9b-126d-42f2-9455-e1b628a00f4b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:26.621204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 248/483] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:26.624486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157550-95aa-455b-8668-ec6cc0f1aa7c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:26.625501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157550-95aa-455b-8668-ec6cc0f1aa7c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:26.626002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76157550-95aa-455b-8668-ec6cc0f1aa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:26.630418 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:26.656964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-76157550-95aa-455b-8668-ec6cc0f1aa7c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:26.658166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-76157550-95aa-455b-8668-ec6cc0f1aa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:26.714906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:26.763358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecdee5-ec20-4b96-bbbd-5eda0f3b9b16 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:26.769641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 249/484] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:26.771138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d697e8-6582-4df2-bd1d-2ffe8eacebad None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:26.771425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d697e8-6582-4df2-bd1d-2ffe8eacebad None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:26.771699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d697e8-6582-4df2-bd1d-2ffe8eacebad None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:26.773243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 250/485] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:26.779155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a79b-561f-4bc5-acd3-bbe1c5f0efd5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:26.779435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a79b-561f-4bc5-acd3-bbe1c5f0efd5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:26.779770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a79b-561f-4bc5-acd3-bbe1c5f0efd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:26.808997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8976a79b-561f-4bc5-acd3-bbe1c5f0efd5 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:26.810811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8976a79b-561f-4bc5-acd3-bbe1c5f0efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:26.819808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3a513-44a7-4c15-bf0b-69f6bf22ba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:26.820436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3a513-44a7-4c15-bf0b-69f6bf22ba8b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:26.820712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3a513-44a7-4c15-bf0b-69f6bf22ba8b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:26.820980 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3a513-44a7-4c15-bf0b-69f6bf22ba8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:26.843306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3a513-44a7-4c15-bf0b-69f6bf22ba8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1fd3a513-44a7-4c15-bf0b-69f6bf22ba8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:26.849018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:26.849891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:26.850708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:26.859026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 236/486] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:26.861584 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3a513-44a7-4c15-bf0b-69f6bf22ba8b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:26.949398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 251/487] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:26.991007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:27.031638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3a513-44a7-4c15-bf0b-69f6bf22ba8b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:27.044478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976a79b-561f-4bc5-acd3-bbe1c5f0efd5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:27.095717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24cce6-72a4-4b16-bca8-7100cd1030ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:27.096227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cce6-72a4-4b16-bca8-7100cd1030ab None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.096605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cce6-72a4-4b16-bca8-7100cd1030ab None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.096771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cce6-72a4-4b16-bca8-7100cd1030ab None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.097529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24cce6-72a4-4b16-bca8-7100cd1030ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:27.097737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24cce6-72a4-4b16-bca8-7100cd1030ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:27.099144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24cce6-72a4-4b16-bca8-7100cd1030ab None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:27.117931 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 237/488] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:27.123532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24cce6-72a4-4b16-bca8-7100cd1030ab None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:27.200062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:27.209434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976a79b-561f-4bc5-acd3-bbe1c5f0efd5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:27.264216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65029ec-0ecf-49c2-b1a0-797e93fea80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:27.265094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65029ec-0ecf-49c2-b1a0-797e93fea80e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.265273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65029ec-0ecf-49c2-b1a0-797e93fea80e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.265497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65029ec-0ecf-49c2-b1a0-797e93fea80e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.276301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65029ec-0ecf-49c2-b1a0-797e93fea80e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b65029ec-0ecf-49c2-b1a0-797e93fea80e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:27.282216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:27.283072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:27.283834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 252/489] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:27.284472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65029ec-0ecf-49c2-b1a0-797e93fea80e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:27.287101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24cce6-72a4-4b16-bca8-7100cd1030ab None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:27.323549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e7304-a8e9-4164-9fc6-768e7576418d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:27.324515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e7304-a8e9-4164-9fc6-768e7576418d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.325028 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e7304-a8e9-4164-9fc6-768e7576418d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.325521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e7304-a8e9-4164-9fc6-768e7576418d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.327835 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:27.339065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e7304-a8e9-4164-9fc6-768e7576418d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:27.341454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e7304-a8e9-4164-9fc6-768e7576418d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-945e7304-a8e9-4164-9fc6-768e7576418d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:27.357346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:27.358263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:27.359088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:27.359088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:27.359088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:27.361164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 238/490] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:27.362182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e7304-a8e9-4164-9fc6-768e7576418d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:27.395445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65029ec-0ecf-49c2-b1a0-797e93fea80e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:27.432499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55a75a-5cba-42d5-b60c-5645beb949c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:27.433129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55a75a-5cba-42d5-b60c-5645beb949c9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.433478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55a75a-5cba-42d5-b60c-5645beb949c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.433678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55a75a-5cba-42d5-b60c-5645beb949c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.444914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55a75a-5cba-42d5-b60c-5645beb949c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5e55a75a-5cba-42d5-b60c-5645beb949c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:27.450544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:27.451405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:27.452176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 253/491] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:27.452812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55a75a-5cba-42d5-b60c-5645beb949c9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:27.472443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:27.478350 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e7304-a8e9-4164-9fc6-768e7576418d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:27.513479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6b9f8-c78e-493d-acb3-0f6191fcdbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:27.514103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6b9f8-c78e-493d-acb3-0f6191fcdbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.514382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6b9f8-c78e-493d-acb3-0f6191fcdbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.514647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6b9f8-c78e-493d-acb3-0f6191fcdbc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.515417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6b9f8-c78e-493d-acb3-0f6191fcdbc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:27.515712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6b9f8-c78e-493d-acb3-0f6191fcdbc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:27.517198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6b9f8-c78e-493d-acb3-0f6191fcdbc2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:27.529823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 239/492] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:27.530668 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6b9f8-c78e-493d-acb3-0f6191fcdbc2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:27.559991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55a75a-5cba-42d5-b60c-5645beb949c9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:27.579619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:27.594054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdea48e-df9a-4993-9184-e217768cd07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:27.594669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdea48e-df9a-4993-9184-e217768cd07d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.594946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdea48e-df9a-4993-9184-e217768cd07d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.595223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdea48e-df9a-4993-9184-e217768cd07d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.595862 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdea48e-df9a-4993-9184-e217768cd07d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:27.596165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdea48e-df9a-4993-9184-e217768cd07d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:27.597542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdea48e-df9a-4993-9184-e217768cd07d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:27.608729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 254/493] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:27.609853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c2334-73d7-4119-9d1e-482bdf54af5e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.610165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c2334-73d7-4119-9d1e-482bdf54af5e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.610444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c2334-73d7-4119-9d1e-482bdf54af5e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.612686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 255/494] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:27.612686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c2334-73d7-4119-9d1e-482bdf54af5e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:27.633064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6b9f8-c78e-493d-acb3-0f6191fcdbc2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:27.666794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7ecdf-72c0-43a4-b55a-41effe3319cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:27.667391 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7ecdf-72c0-43a4-b55a-41effe3319cc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.667674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7ecdf-72c0-43a4-b55a-41effe3319cc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.667949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7ecdf-72c0-43a4-b55a-41effe3319cc None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.668641 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7ecdf-72c0-43a4-b55a-41effe3319cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:27.668946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7ecdf-72c0-43a4-b55a-41effe3319cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:27.670348 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7ecdf-72c0-43a4-b55a-41effe3319cc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:27.677943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 240/495] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:27.679167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba85e-0e9d-4155-a380-796d172053ff None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.679460 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba85e-0e9d-4155-a380-796d172053ff None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.679732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba85e-0e9d-4155-a380-796d172053ff None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.680925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 241/496] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:27.681604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cba85e-0e9d-4155-a380-796d172053ff None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:27.693666 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:27.718247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c2334-73d7-4119-9d1e-482bdf54af5e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:27.750760 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b835bee-5a3b-49ab-9643-53cad4388d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:27.751426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835bee-5a3b-49ab-9643-53cad4388d69 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.751706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835bee-5a3b-49ab-9643-53cad4388d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.751973 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b835bee-5a3b-49ab-9643-53cad4388d69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.761751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b835bee-5a3b-49ab-9643-53cad4388d69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:27.763741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b835bee-5a3b-49ab-9643-53cad4388d69 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1b835bee-5a3b-49ab-9643-53cad4388d69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:27.778673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:27.779550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:27.780367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:27.780367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:27.780367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:27.780367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 256/497] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:27.780896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd771-ace8-4e84-aa52-0f57f544c817 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.781177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd771-ace8-4e84-aa52-0f57f544c817 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.781444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd771-ace8-4e84-aa52-0f57f544c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.785589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cba85e-0e9d-4155-a380-796d172053ff None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:27.796799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:27.798721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-428cd771-ace8-4e84-aa52-0f57f544c817 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:27.799987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-428cd771-ace8-4e84-aa52-0f57f544c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:27.820436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e330a-2c51-4b07-bc36-c5fffc988bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:27.821051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e330a-2c51-4b07-bc36-c5fffc988bbd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.821329 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e330a-2c51-4b07-bc36-c5fffc988bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.821595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e330a-2c51-4b07-bc36-c5fffc988bbd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.828358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e330a-2c51-4b07-bc36-c5fffc988bbd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:27.829854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e330a-2c51-4b07-bc36-c5fffc988bbd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5a2e330a-2c51-4b07-bc36-c5fffc988bbd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:27.842798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:27.843842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 242/498] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 19 15:09:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:27.844806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e330a-2c51-4b07-bc36-c5fffc988bbd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:27.868388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 257/499] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:27.869535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7007-2560-4607-a82a-736221ff2bed None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:27.869820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7007-2560-4607-a82a-736221ff2bed None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:27.870122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7007-2560-4607-a82a-736221ff2bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:27.898288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ed2e7007-2560-4607-a82a-736221ff2bed None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:27.899787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ed2e7007-2560-4607-a82a-736221ff2bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:27.953008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e330a-2c51-4b07-bc36-c5fffc988bbd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:27.956013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:27.971689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 258/500] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:27.972410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e7007-2560-4607-a82a-736221ff2bed None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.000264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7ef2c-1aa4-474f-a405-d9bb5b7d076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:28.001703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7ef2c-1aa4-474f-a405-d9bb5b7d076e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:28.002286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7ef2c-1aa4-474f-a405-d9bb5b7d076e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:28.002736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7ef2c-1aa4-474f-a405-d9bb5b7d076e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:28.017233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7ef2c-1aa4-474f-a405-d9bb5b7d076e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:28.019442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7ef2c-1aa4-474f-a405-d9bb5b7d076e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-16d7ef2c-1aa4-474f-a405-d9bb5b7d076e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:28.039339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:28.040426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:28.041470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:28.041470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:28.041470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:28.043104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 243/501] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:28.045259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7ef2c-1aa4-474f-a405-d9bb5b7d076e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.078434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:28.079214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e7007-2560-4607-a82a-736221ff2bed None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:28.121274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54c281-a0f4-4a58-bbcb-0cc155654e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:28.121917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54c281-a0f4-4a58-bbcb-0cc155654e1e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:28.122220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54c281-a0f4-4a58-bbcb-0cc155654e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:28.122489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54c281-a0f4-4a58-bbcb-0cc155654e1e None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:28.123225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54c281-a0f4-4a58-bbcb-0cc155654e1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:28.123525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54c281-a0f4-4a58-bbcb-0cc155654e1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:28.124954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54c281-a0f4-4a58-bbcb-0cc155654e1e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:28.141548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 259/502] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:28.142424 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54c281-a0f4-4a58-bbcb-0cc155654e1e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.173606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7ef2c-1aa4-474f-a405-d9bb5b7d076e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:28.193669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:28.209377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff639355-a0a6-494d-90a0-d570e427fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:28.210090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff639355-a0a6-494d-90a0-d570e427fb5f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:28.210375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff639355-a0a6-494d-90a0-d570e427fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:28.210646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff639355-a0a6-494d-90a0-d570e427fb5f None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:28.211384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff639355-a0a6-494d-90a0-d570e427fb5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:28.211692 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff639355-a0a6-494d-90a0-d570e427fb5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:28.213139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff639355-a0a6-494d-90a0-d570e427fb5f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:28.247415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54c281-a0f4-4a58-bbcb-0cc155654e1e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:28.251102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 244/503] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 19 15:09:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:28.251930 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff639355-a0a6-494d-90a0-d570e427fb5f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.281393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436ade5-633a-4f84-b0fb-bb8afa69dafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:28.281991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ade5-633a-4f84-b0fb-bb8afa69dafe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:28.282292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ade5-633a-4f84-b0fb-bb8afa69dafe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:28.282564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ade5-633a-4f84-b0fb-bb8afa69dafe None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:28.283191 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436ade5-633a-4f84-b0fb-bb8afa69dafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:28.283488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436ade5-633a-4f84-b0fb-bb8afa69dafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:28.284838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436ade5-633a-4f84-b0fb-bb8afa69dafe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:28.296432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 260/504] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:28.297196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436ade5-633a-4f84-b0fb-bb8afa69dafe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.333933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:28.353120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff639355-a0a6-494d-90a0-d570e427fb5f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:28.385811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64518165-bf7e-4f4d-932d-ae01326e2dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:28.386393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64518165-bf7e-4f4d-932d-ae01326e2dae None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:28.386672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64518165-bf7e-4f4d-932d-ae01326e2dae None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:28.386945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64518165-bf7e-4f4d-932d-ae01326e2dae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:28.394911 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436ade5-633a-4f84-b0fb-bb8afa69dafe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:28.397147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64518165-bf7e-4f4d-932d-ae01326e2dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-64518165-bf7e-4f4d-932d-ae01326e2dae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:28.401833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:28.402890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 245/505] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:28.404249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64518165-bf7e-4f4d-932d-ae01326e2dae None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.406782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:28.433069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cee85-5624-42d6-9ccf-68cb16d26764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:28.433690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cee85-5624-42d6-9ccf-68cb16d26764 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:28.433967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cee85-5624-42d6-9ccf-68cb16d26764 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:28.434311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cee85-5624-42d6-9ccf-68cb16d26764 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:28.441531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cee85-5624-42d6-9ccf-68cb16d26764 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:28.442978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cee85-5624-42d6-9ccf-68cb16d26764 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d33cee85-5624-42d6-9ccf-68cb16d26764 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:28.455203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:28.456123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 261/506] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:28.457038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cee85-5624-42d6-9ccf-68cb16d26764 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.504723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64518165-bf7e-4f4d-932d-ae01326e2dae None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:28.538985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87e286-90f2-4745-bfcb-23a9077f0d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:28.539606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87e286-90f2-4745-bfcb-23a9077f0d0a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:28.539880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87e286-90f2-4745-bfcb-23a9077f0d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:28.540156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87e286-90f2-4745-bfcb-23a9077f0d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:28.548595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:28.550760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87e286-90f2-4745-bfcb-23a9077f0d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:28.552313 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87e286-90f2-4745-bfcb-23a9077f0d0a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:28.556466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cee85-5624-42d6-9ccf-68cb16d26764 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fb87e286-90f2-4745-bfcb-23a9077f0d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:28.567576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:28.568483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:28.569311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:28.569311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:28.569311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:28.569311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 246/507] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:28.569546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87e286-90f2-4745-bfcb-23a9077f0d0a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.592049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37488e0b-c394-48cf-9038-cf906835930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:28.592656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37488e0b-c394-48cf-9038-cf906835930b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:28.592934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37488e0b-c394-48cf-9038-cf906835930b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:28.593204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37488e0b-c394-48cf-9038-cf906835930b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:28.627610 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:28.661903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37488e0b-c394-48cf-9038-cf906835930b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:28.663315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37488e0b-c394-48cf-9038-cf906835930b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:28.667101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87e286-90f2-4745-bfcb-23a9077f0d0a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:28.701306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f3b86-847a-46ed-b1a2-49b1ef08777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:28.701928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f3b86-847a-46ed-b1a2-49b1ef08777b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:28.702246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f3b86-847a-46ed-b1a2-49b1ef08777b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:28.702522 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f3b86-847a-46ed-b1a2-49b1ef08777b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:28.709690 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f3b86-847a-46ed-b1a2-49b1ef08777b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:28.711170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f3b86-847a-46ed-b1a2-49b1ef08777b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ce7f3b86-847a-46ed-b1a2-49b1ef08777b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:28.723007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:28.723955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 247/508] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:28.724830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f3b86-847a-46ed-b1a2-49b1ef08777b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.762608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 262/509] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:28.763435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37488e0b-c394-48cf-9038-cf906835930b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.776807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:28.823769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f3b86-847a-46ed-b1a2-49b1ef08777b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:28.829375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:28.861148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d714078-9826-47cf-bfb8-0e1a4769b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:28.861742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d714078-9826-47cf-bfb8-0e1a4769b57f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:28.862015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d714078-9826-47cf-bfb8-0e1a4769b57f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:28.862313 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d714078-9826-47cf-bfb8-0e1a4769b57f None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:28.862970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d714078-9826-47cf-bfb8-0e1a4769b57f None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:28.863269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d714078-9826-47cf-bfb8-0e1a4769b57f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:28.864030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37488e0b-c394-48cf-9038-cf906835930b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:28.864610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d714078-9826-47cf-bfb8-0e1a4769b57f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:28.872431 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 248/510] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:28.873211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d714078-9826-47cf-bfb8-0e1a4769b57f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.897051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd796f4b-9f5c-4a29-b81b-a370b780b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:28.897650 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd796f4b-9f5c-4a29-b81b-a370b780b58f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:28.897925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd796f4b-9f5c-4a29-b81b-a370b780b58f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:28.898218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd796f4b-9f5c-4a29-b81b-a370b780b58f None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:28.898935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd796f4b-9f5c-4a29-b81b-a370b780b58f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:28.899233 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd796f4b-9f5c-4a29-b81b-a370b780b58f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:28.900640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd796f4b-9f5c-4a29-b81b-a370b780b58f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:28.936350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 263/511] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 19 15:09:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:28.936904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd796f4b-9f5c-4a29-b81b-a370b780b58f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:28.974757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d714078-9826-47cf-bfb8-0e1a4769b57f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:28.989000 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:29.009153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ee3bf-e6b1-4429-8371-e6716d80ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:29.009756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ee3bf-e6b1-4429-8371-e6716d80ea4c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:29.010054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ee3bf-e6b1-4429-8371-e6716d80ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:29.010345 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ee3bf-e6b1-4429-8371-e6716d80ea4c None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:29.010991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ee3bf-e6b1-4429-8371-e6716d80ea4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:29.011298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ee3bf-e6b1-4429-8371-e6716d80ea4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:29.013195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ee3bf-e6b1-4429-8371-e6716d80ea4c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:29.024463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 249/512] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:29.025243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ee3bf-e6b1-4429-8371-e6716d80ea4c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:29.039082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd796f4b-9f5c-4a29-b81b-a370b780b58f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:29.063475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:29.072328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616ea18-1870-467a-9673-a3dd8aebef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:29.072937 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616ea18-1870-467a-9673-a3dd8aebef90 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:29.073220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616ea18-1870-467a-9673-a3dd8aebef90 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:29.073495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616ea18-1870-467a-9673-a3dd8aebef90 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:29.074252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616ea18-1870-467a-9673-a3dd8aebef90 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:29.074552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616ea18-1870-467a-9673-a3dd8aebef90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:29.076523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616ea18-1870-467a-9673-a3dd8aebef90 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:29.093681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 264/513] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 19 15:09:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:29.094487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616ea18-1870-467a-9673-a3dd8aebef90 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:29.125567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ee3bf-e6b1-4429-8371-e6716d80ea4c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:29.159867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284e6b9-1958-4b5f-af91-5fef25ec93b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:29.160483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284e6b9-1958-4b5f-af91-5fef25ec93b0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:29.160763 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284e6b9-1958-4b5f-af91-5fef25ec93b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:29.161041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284e6b9-1958-4b5f-af91-5fef25ec93b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:29.170738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284e6b9-1958-4b5f-af91-5fef25ec93b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:29.172171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284e6b9-1958-4b5f-af91-5fef25ec93b0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f284e6b9-1958-4b5f-af91-5fef25ec93b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:29.186142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:29.187592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:29.188447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:29.188447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:29.188447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:29.188447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 250/514] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:29.188447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284e6b9-1958-4b5f-af91-5fef25ec93b0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:29.198410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616ea18-1870-467a-9673-a3dd8aebef90 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:29.214263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:29.233702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c6700-0992-400c-93ae-b4b785f2658f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:29.234341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c6700-0992-400c-93ae-b4b785f2658f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:29.234618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c6700-0992-400c-93ae-b4b785f2658f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:29.234889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c6700-0992-400c-93ae-b4b785f2658f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:29.244436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c6700-0992-400c-93ae-b4b785f2658f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:29.245910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c6700-0992-400c-93ae-b4b785f2658f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-fc9c6700-0992-400c-93ae-b4b785f2658f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:29.259784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:29.261294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:29.262225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:29.262225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:29.262225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:29.262225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 265/515] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:29.262225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c6700-0992-400c-93ae-b4b785f2658f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:29.291736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284e6b9-1958-4b5f-af91-5fef25ec93b0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:29.297685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:29.326278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ea4b6-3e79-4383-b54b-97d4c4c371eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:29.326870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea4b6-3e79-4383-b54b-97d4c4c371eb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:29.327143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea4b6-3e79-4383-b54b-97d4c4c371eb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:29.327407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea4b6-3e79-4383-b54b-97d4c4c371eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:29.362804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c6700-0992-400c-93ae-b4b785f2658f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:29.393476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ea4b6-3e79-4383-b54b-97d4c4c371eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:29.394958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ea4b6-3e79-4383-b54b-97d4c4c371eb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:29.395288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce583d-8132-4cef-96b3-870073d406d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:29.395890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce583d-8132-4cef-96b3-870073d406d6 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:29.396171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce583d-8132-4cef-96b3-870073d406d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:29.396448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce583d-8132-4cef-96b3-870073d406d6 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:29.397077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce583d-8132-4cef-96b3-870073d406d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:29.398533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce583d-8132-4cef-96b3-870073d406d6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:29.420454 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 266/516] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:09:29 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:09:29.421551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce583d-8132-4cef-96b3-870073d406d6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:29.423526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:29.512411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 251/517] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:29.512411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ea4b6-3e79-4383-b54b-97d4c4c371eb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:29.533348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:29.546675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce583d-8132-4cef-96b3-870073d406d6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:29.592270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5cdb0-a08a-432d-a351-fff27e73f822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:29.592894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5cdb0-a08a-432d-a351-fff27e73f822 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:29.593843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5cdb0-a08a-432d-a351-fff27e73f822 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:29.593843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5cdb0-a08a-432d-a351-fff27e73f822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:29.627321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ea4b6-3e79-4383-b54b-97d4c4c371eb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:29.656274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:29.667759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5cdb0-a08a-432d-a351-fff27e73f822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:29.668090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2925197-f397-4e67-a86a-148e77b71a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:29.669461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2925197-f397-4e67-a86a-148e77b71a81 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:29.669797 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5cdb0-a08a-432d-a351-fff27e73f822 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:29.669893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2925197-f397-4e67-a86a-148e77b71a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:29.670110 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2925197-f397-4e67-a86a-148e77b71a81 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:29.670756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2925197-f397-4e67-a86a-148e77b71a81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:29.671069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2925197-f397-4e67-a86a-148e77b71a81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:29.672672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2925197-f397-4e67-a86a-148e77b71a81 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:29.689065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 252/518] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:29.689065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2925197-f397-4e67-a86a-148e77b71a81 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:29.768045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:29.779332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 267/519] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:29.780304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5cdb0-a08a-432d-a351-fff27e73f822 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:29.800937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2925197-f397-4e67-a86a-148e77b71a81 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:29.838617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a65233-f5f5-4110-9980-2874aafd24e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:29.839337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a65233-f5f5-4110-9980-2874aafd24e7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:29.839619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a65233-f5f5-4110-9980-2874aafd24e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:29.840011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a65233-f5f5-4110-9980-2874aafd24e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:29.841217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a65233-f5f5-4110-9980-2874aafd24e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:29.841522 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a65233-f5f5-4110-9980-2874aafd24e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:29.843021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a65233-f5f5-4110-9980-2874aafd24e7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:29.860205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 253/520] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:29.860205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a65233-f5f5-4110-9980-2874aafd24e7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:29.889763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5cdb0-a08a-432d-a351-fff27e73f822 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:29.907911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:29.929825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850468c-8a97-4316-9dee-a12b5e5058f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:29.930485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850468c-8a97-4316-9dee-a12b5e5058f5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:29.930775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850468c-8a97-4316-9dee-a12b5e5058f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:29.931049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850468c-8a97-4316-9dee-a12b5e5058f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:29.941254 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850468c-8a97-4316-9dee-a12b5e5058f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:29.942890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850468c-8a97-4316-9dee-a12b5e5058f5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2850468c-8a97-4316-9dee-a12b5e5058f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:29.957783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:29.958749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:29.964364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:29.964364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:29.964364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:29.964364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 268/521] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:29.964364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850468c-8a97-4316-9dee-a12b5e5058f5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:29.976255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a65233-f5f5-4110-9980-2874aafd24e7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.007000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:30.016411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf2152-9493-4c5b-a1b2-08baf0139e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.017294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf2152-9493-4c5b-a1b2-08baf0139e99 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.017800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf2152-9493-4c5b-a1b2-08baf0139e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.018395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf2152-9493-4c5b-a1b2-08baf0139e99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.025053 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf2152-9493-4c5b-a1b2-08baf0139e99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:30.026645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf2152-9493-4c5b-a1b2-08baf0139e99 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d3cf2152-9493-4c5b-a1b2-08baf0139e99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:30.039227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:30.040255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:30.041239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:30.041239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:30.041239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:30.041239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:30.041239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:30.041239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:30.041239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:30.041239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:30.041657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 254/522] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:30.042206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf2152-9493-4c5b-a1b2-08baf0139e99 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:30.067767 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850468c-8a97-4316-9dee-a12b5e5058f5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.102519 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855617-602a-4d30-90e4-547e4985bad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.103152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855617-602a-4d30-90e4-547e4985bad2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.103434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855617-602a-4d30-90e4-547e4985bad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.103711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855617-602a-4d30-90e4-547e4985bad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.114135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855617-602a-4d30-90e4-547e4985bad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:30.115593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855617-602a-4d30-90e4-547e4985bad2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8b855617-602a-4d30-90e4-547e4985bad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:30.130821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:30.131706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:30.132554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:30.132554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:30.132554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:30.132554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 269/523] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:30.133291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855617-602a-4d30-90e4-547e4985bad2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:30.153410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf2152-9493-4c5b-a1b2-08baf0139e99 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.161677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:30.192443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3265b95-2850-4a51-a5a6-fa36d870dc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.193177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3265b95-2850-4a51-a5a6-fa36d870dc06 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.193372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3265b95-2850-4a51-a5a6-fa36d870dc06 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.193655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3265b95-2850-4a51-a5a6-fa36d870dc06 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.201117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3265b95-2850-4a51-a5a6-fa36d870dc06 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:30.202668 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3265b95-2850-4a51-a5a6-fa36d870dc06 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d3265b95-2850-4a51-a5a6-fa36d870dc06 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:30.215539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:30.216624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 255/524] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:30.217501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3265b95-2850-4a51-a5a6-fa36d870dc06 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:30.234326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:30.240388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855617-602a-4d30-90e4-547e4985bad2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.276401 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c20c5-ce8c-4f1c-b7bd-cf53f6e821a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.277005 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c20c5-ce8c-4f1c-b7bd-cf53f6e821a5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.277191 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c20c5-ce8c-4f1c-b7bd-cf53f6e821a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.277461 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c20c5-ce8c-4f1c-b7bd-cf53f6e821a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.278134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c20c5-ce8c-4f1c-b7bd-cf53f6e821a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:30.278441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c20c5-ce8c-4f1c-b7bd-cf53f6e821a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:30.279799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c20c5-ce8c-4f1c-b7bd-cf53f6e821a5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:30.291170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 270/525] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:30.291963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c20c5-ce8c-4f1c-b7bd-cf53f6e821a5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:30.327365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3265b95-2850-4a51-a5a6-fa36d870dc06 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.363817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701044bf-235d-4bb8-bcb1-45d46d24e720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.364576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701044bf-235d-4bb8-bcb1-45d46d24e720 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.364857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701044bf-235d-4bb8-bcb1-45d46d24e720 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.365132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701044bf-235d-4bb8-bcb1-45d46d24e720 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.365827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701044bf-235d-4bb8-bcb1-45d46d24e720 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:30.366168 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701044bf-235d-4bb8-bcb1-45d46d24e720 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:30.367617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701044bf-235d-4bb8-bcb1-45d46d24e720 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:30.386602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 256/526] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:30.387972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701044bf-235d-4bb8-bcb1-45d46d24e720 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:30.399749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c20c5-ce8c-4f1c-b7bd-cf53f6e821a5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.420288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:30.435337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821719eb-d327-4089-9628-57d07579440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.435949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821719eb-d327-4089-9628-57d07579440f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.436226 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821719eb-d327-4089-9628-57d07579440f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.436502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821719eb-d327-4089-9628-57d07579440f None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.437142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821719eb-d327-4089-9628-57d07579440f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:30.437443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821719eb-d327-4089-9628-57d07579440f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:30.438849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821719eb-d327-4089-9628-57d07579440f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:30.450575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 271/527] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:30.455662 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821719eb-d327-4089-9628-57d07579440f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:30.474212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:30.501016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701044bf-235d-4bb8-bcb1-45d46d24e720 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.537757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8868e0-05a3-4b40-8256-2709b67c9e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.538314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8868e0-05a3-4b40-8256-2709b67c9e6a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.538593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8868e0-05a3-4b40-8256-2709b67c9e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.538863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8868e0-05a3-4b40-8256-2709b67c9e6a None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.539602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8868e0-05a3-4b40-8256-2709b67c9e6a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:30.539907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8868e0-05a3-4b40-8256-2709b67c9e6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:30.541340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8868e0-05a3-4b40-8256-2709b67c9e6a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:30.567435 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 257/528] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Aug 19 15:09:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:30.567435 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8868e0-05a3-4b40-8256-2709b67c9e6a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:30.576160 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821719eb-d327-4089-9628-57d07579440f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.611513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cc409-8f6e-4b89-be06-37560d30b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.612147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cc409-8f6e-4b89-be06-37560d30b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.612418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cc409-8f6e-4b89-be06-37560d30b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.612691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cc409-8f6e-4b89-be06-37560d30b6d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.619402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cc409-8f6e-4b89-be06-37560d30b6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:30.620850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cc409-8f6e-4b89-be06-37560d30b6d1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c83cc409-8f6e-4b89-be06-37560d30b6d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:30.633449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:30.634400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:30.635236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:30.635236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:30.635236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:30.635236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:30.635236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:30.635236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:30.635236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:30.635236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:30.635236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 272/529] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:30.635694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cc409-8f6e-4b89-be06-37560d30b6d1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:30.658436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:30.676341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8868e0-05a3-4b40-8256-2709b67c9e6a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.713706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717efab3-cb06-47e1-9ccb-3f2f6be771f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.714348 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717efab3-cb06-47e1-9ccb-3f2f6be771f5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.714636 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717efab3-cb06-47e1-9ccb-3f2f6be771f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.714953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717efab3-cb06-47e1-9ccb-3f2f6be771f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.715928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717efab3-cb06-47e1-9ccb-3f2f6be771f5 None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=a86ca59cbf894c508b3439b08715da86) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:30.716805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717efab3-cb06-47e1-9ccb-3f2f6be771f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:30.718275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:30.718888 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717efab3-cb06-47e1-9ccb-3f2f6be771f5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:30.733597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 258/530] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:30 2022] GET /identity/v3/role_assignments?user.id=a86ca59cbf894c508b3439b08715da86&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:30.733597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717efab3-cb06-47e1-9ccb-3f2f6be771f5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:30.745145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cc409-8f6e-4b89-be06-37560d30b6d1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.784704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcb8ab-c611-49c8-81a8-11ed286daac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.785351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcb8ab-c611-49c8-81a8-11ed286daac2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.785752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcb8ab-c611-49c8-81a8-11ed286daac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.786041 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcb8ab-c611-49c8-81a8-11ed286daac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.794905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcb8ab-c611-49c8-81a8-11ed286daac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:30.796321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcb8ab-c611-49c8-81a8-11ed286daac2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7adcb8ab-c611-49c8-81a8-11ed286daac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:30.810407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:30.811321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:30.812144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:30.812144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:30.812144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:30.812144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:30.812144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:30.812144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:30.812144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:30.812144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:30.812144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 273/531] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:30.812587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcb8ab-c611-49c8-81a8-11ed286daac2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:30.873877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717efab3-cb06-47e1-9ccb-3f2f6be771f5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.927550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1b809-726d-467b-a939-f1b970078f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.928161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b809-726d-467b-a939-f1b970078f3f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.928438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b809-726d-467b-a939-f1b970078f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.928707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b809-726d-467b-a939-f1b970078f3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.936248 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcb8ab-c611-49c8-81a8-11ed286daac2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:30.950958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:30.984244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dcf26-d873-40a4-96bc-56472f070e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:30.985801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dcf26-d873-40a4-96bc-56472f070e79 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:30.986498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dcf26-d873-40a4-96bc-56472f070e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:30.986978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52dcf26-d873-40a4-96bc-56472f070e79 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:30.988140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dcf26-d873-40a4-96bc-56472f070e79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:30.989176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dcf26-d873-40a4-96bc-56472f070e79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:30.991426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52dcf26-d873-40a4-96bc-56472f070e79 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:30.998283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:31.016784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1b809-726d-467b-a939-f1b970078f3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:31.018787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1b809-726d-467b-a939-f1b970078f3f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:31.023223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 274/532] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:31.024290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dcf26-d873-40a4-96bc-56472f070e79 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:31.144792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 259/533] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:31.144792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1b809-726d-467b-a939-f1b970078f3f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:31.175937 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52dcf26-d873-40a4-96bc-56472f070e79 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:31.193530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:31.225196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b616693-27c6-4ffe-b695-69dd62c15fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:31.226453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b616693-27c6-4ffe-b695-69dd62c15fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:31.227015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b616693-27c6-4ffe-b695-69dd62c15fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:31.227728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b616693-27c6-4ffe-b695-69dd62c15fa2 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:31.229082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b616693-27c6-4ffe-b695-69dd62c15fa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:31.230162 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b616693-27c6-4ffe-b695-69dd62c15fa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:31.233059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b616693-27c6-4ffe-b695-69dd62c15fa2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:31.249101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1b809-726d-467b-a939-f1b970078f3f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:31.250276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 275/534] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:31.251356 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b616693-27c6-4ffe-b695-69dd62c15fa2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:31.289655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a9688-08a5-4f18-9329-45e5a2bf13b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:31.290373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9688-08a5-4f18-9329-45e5a2bf13b2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:31.290655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9688-08a5-4f18-9329-45e5a2bf13b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:31.290928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9688-08a5-4f18-9329-45e5a2bf13b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:31.291656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a9688-08a5-4f18-9329-45e5a2bf13b2 None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=c23bb3a6586247e0a11ece33569d6d69) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:31.291962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a9688-08a5-4f18-9329-45e5a2bf13b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:31.293432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a9688-08a5-4f18-9329-45e5a2bf13b2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:31.303788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 260/535] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:31 2022] GET /identity/v3/role_assignments?user.id=c23bb3a6586247e0a11ece33569d6d69&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:31.304860 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a9688-08a5-4f18-9329-45e5a2bf13b2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:31.343426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:31.410074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b616693-27c6-4ffe-b695-69dd62c15fa2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:31.433964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a9688-08a5-4f18-9329-45e5a2bf13b2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:31.447674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8820361-27c6-4b14-a3bc-4061e655f9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:31.448708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820361-27c6-4b14-a3bc-4061e655f9bd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:31.449201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820361-27c6-4b14-a3bc-4061e655f9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:31.449668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8820361-27c6-4b14-a3bc-4061e655f9bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:31.450307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:31.461811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8820361-27c6-4b14-a3bc-4061e655f9bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:31.463696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8820361-27c6-4b14-a3bc-4061e655f9bd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:31.475230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cce1ae-d654-4d7b-a9f2-1705beacaa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:31.475841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce1ae-d654-4d7b-a9f2-1705beacaa41 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:31.476134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce1ae-d654-4d7b-a9f2-1705beacaa41 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:31.476410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce1ae-d654-4d7b-a9f2-1705beacaa41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:31.477155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cce1ae-d654-4d7b-a9f2-1705beacaa41 None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=895028dd70a0415595a0ff8ebedb1f0f) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:31.477466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cce1ae-d654-4d7b-a9f2-1705beacaa41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:31.478929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cce1ae-d654-4d7b-a9f2-1705beacaa41 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e8820361-27c6-4b14-a3bc-4061e655f9bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:31.482703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:31.483559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:31.484369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:31.484369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:31.484369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:31.486022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 261/536] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:31 2022] GET /identity/v3/role_assignments?user.id=895028dd70a0415595a0ff8ebedb1f0f&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:31.486559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 276/537] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:31.491020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08e623-3ce0-4420-80b0-f314ce8bf9ad None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:31.491020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08e623-3ce0-4420-80b0-f314ce8bf9ad None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:31.491020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08e623-3ce0-4420-80b0-f314ce8bf9ad None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:31.491476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 262/538] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:31.493022 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8820361-27c6-4b14-a3bc-4061e655f9bd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:31.495109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6a4a-c7bf-47e5-b454-5df70ec279c3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:31.495391 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6a4a-c7bf-47e5-b454-5df70ec279c3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:31.495656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd6a4a-c7bf-47e5-b454-5df70ec279c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:31.520777 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-edcd6a4a-c7bf-47e5-b454-5df70ec279c3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:31.522250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-edcd6a4a-c7bf-47e5-b454-5df70ec279c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:31.632690 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 263/539] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:31.667909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8820361-27c6-4b14-a3bc-4061e655f9bd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:31.678234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:31.709498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdc75d-23b5-47eb-a25b-a42792cbf70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:31.710135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdc75d-23b5-47eb-a25b-a42792cbf70a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:31.710420 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdc75d-23b5-47eb-a25b-a42792cbf70a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:31.710693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fdc75d-23b5-47eb-a25b-a42792cbf70a None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:31.711399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdc75d-23b5-47eb-a25b-a42792cbf70a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:31.711710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdc75d-23b5-47eb-a25b-a42792cbf70a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:31.713078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fdc75d-23b5-47eb-a25b-a42792cbf70a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:31.726081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 277/540] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:31.735208 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6a4a-c7bf-47e5-b454-5df70ec279c3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:31.879358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd6a4a-c7bf-47e5-b454-5df70ec279c3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:31.888873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:31.928170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491c8be-78bd-4e50-881e-4e684972c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:31.928726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c8be-78bd-4e50-881e-4e684972c05f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:31.929010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c8be-78bd-4e50-881e-4e684972c05f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:31.929287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491c8be-78bd-4e50-881e-4e684972c05f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:31.943411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491c8be-78bd-4e50-881e-4e684972c05f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:31.944921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491c8be-78bd-4e50-881e-4e684972c05f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5491c8be-78bd-4e50-881e-4e684972c05f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:31.960696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:31.961608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:31.963138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:31.963138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:31.963138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:31.963138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:31.963138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:31.963138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:31.963138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:31.963138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:31.963138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 264/541] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:31.967736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdc75d-23b5-47eb-a25b-a42792cbf70a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:31.972782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491c8be-78bd-4e50-881e-4e684972c05f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:32.109470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491c8be-78bd-4e50-881e-4e684972c05f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:32.111916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fdc75d-23b5-47eb-a25b-a42792cbf70a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:32.156651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814cd95-843c-43a9-99ca-3c9d76df3b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:32.157267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814cd95-843c-43a9-99ca-3c9d76df3b5f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:32.157594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814cd95-843c-43a9-99ca-3c9d76df3b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:32.157875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814cd95-843c-43a9-99ca-3c9d76df3b5f None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:32.158663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814cd95-843c-43a9-99ca-3c9d76df3b5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:32.158999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814cd95-843c-43a9-99ca-3c9d76df3b5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:32.160404 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814cd95-843c-43a9-99ca-3c9d76df3b5f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:32.160857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a74f40-1739-4c38-9537-1578cd493fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:32.161729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a74f40-1739-4c38-9537-1578cd493fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:32.162285 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a74f40-1739-4c38-9537-1578cd493fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:32.162754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a74f40-1739-4c38-9537-1578cd493fa1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:32.178285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 278/542] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:32.180158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814cd95-843c-43a9-99ca-3c9d76df3b5f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:32.192091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a74f40-1739-4c38-9537-1578cd493fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-93a74f40-1739-4c38-9537-1578cd493fa1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:32.197358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:32.198649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:32.199411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:32.201968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 265/543] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:32.211035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a74f40-1739-4c38-9537-1578cd493fa1 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:32.217496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:32.253131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:32.339781 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a74f40-1739-4c38-9537-1578cd493fa1 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:32.393048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb4f5b-69e9-40f7-bea4-6b2872017a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:32.393663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb4f5b-69e9-40f7-bea4-6b2872017a87 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:32.393941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb4f5b-69e9-40f7-bea4-6b2872017a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:32.394236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb4f5b-69e9-40f7-bea4-6b2872017a87 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:32.394906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb4f5b-69e9-40f7-bea4-6b2872017a87 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:32.395210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb4f5b-69e9-40f7-bea4-6b2872017a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:32.396574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb4f5b-69e9-40f7-bea4-6b2872017a87 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:32.401422 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814cd95-843c-43a9-99ca-3c9d76df3b5f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:32.421444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 266/544] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:32.424435 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb4f5b-69e9-40f7-bea4-6b2872017a87 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:32.490113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93aa9b6-5f1c-4e85-9eb0-67a38f2630cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:32.490657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aa9b6-5f1c-4e85-9eb0-67a38f2630cf None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:32.490941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aa9b6-5f1c-4e85-9eb0-67a38f2630cf None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:32.491215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93aa9b6-5f1c-4e85-9eb0-67a38f2630cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:32.491959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93aa9b6-5f1c-4e85-9eb0-67a38f2630cf None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=a220cf4fafe84d6498bc959a9cd18df7) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:32.492272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93aa9b6-5f1c-4e85-9eb0-67a38f2630cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:32.493716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93aa9b6-5f1c-4e85-9eb0-67a38f2630cf None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:32.509028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 279/545] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:32 2022] GET /identity/v3/role_assignments?user.id=a220cf4fafe84d6498bc959a9cd18df7&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:32.558050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:32.570246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb4f5b-69e9-40f7-bea4-6b2872017a87 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:32.621543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95721b0-48b8-44f1-81a7-7b32fbed6559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:32.622768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95721b0-48b8-44f1-81a7-7b32fbed6559 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:32.623056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95721b0-48b8-44f1-81a7-7b32fbed6559 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:32.623324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95721b0-48b8-44f1-81a7-7b32fbed6559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:32.643539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95721b0-48b8-44f1-81a7-7b32fbed6559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:32.645600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95721b0-48b8-44f1-81a7-7b32fbed6559 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c95721b0-48b8-44f1-81a7-7b32fbed6559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:32.671332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:32.672262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:32.673092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:32.673092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:32.673092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:32.673092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 267/546] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:32.678593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93aa9b6-5f1c-4e85-9eb0-67a38f2630cf None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:32.801645 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:32.814064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93aa9b6-5f1c-4e85-9eb0-67a38f2630cf None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:32.856609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510a685-ca2b-4e4c-bc80-f09619904295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:32.857227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a685-ca2b-4e4c-bc80-f09619904295 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:32.857509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a685-ca2b-4e4c-bc80-f09619904295 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:32.857785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a685-ca2b-4e4c-bc80-f09619904295 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:32.858461 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510a685-ca2b-4e4c-bc80-f09619904295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:32.858763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510a685-ca2b-4e4c-bc80-f09619904295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:32.860155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510a685-ca2b-4e4c-bc80-f09619904295 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:32.872807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 280/547] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:32.878441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95721b0-48b8-44f1-81a7-7b32fbed6559 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:32.934217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798d53-c5a5-4d6b-94bb-97646b536a1c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:32.935032 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798d53-c5a5-4d6b-94bb-97646b536a1c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:32.935282 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798d53-c5a5-4d6b-94bb-97646b536a1c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:32.936834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 281/548] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:32.941807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df002f-8de4-4a51-a9f6-8bc71a834790 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:32.942117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df002f-8de4-4a51-a9f6-8bc71a834790 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:32.942399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df002f-8de4-4a51-a9f6-8bc71a834790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:32.975041 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f7df002f-8de4-4a51-a9f6-8bc71a834790 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:32.976258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f7df002f-8de4-4a51-a9f6-8bc71a834790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:33.073909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95721b0-48b8-44f1-81a7-7b32fbed6559 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:33.109468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 282/549] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:09:33.143323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bb3a2-91b6-42eb-9f98-44ca5df3a4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:33.143963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb3a2-91b6-42eb-9f98-44ca5df3a4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:33.144245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb3a2-91b6-42eb-9f98-44ca5df3a4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:33.144518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb3a2-91b6-42eb-9f98-44ca5df3a4f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:33.155426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bb3a2-91b6-42eb-9f98-44ca5df3a4f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:33.156897 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bb3a2-91b6-42eb-9f98-44ca5df3a4f7 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:33.160507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6c0bb3a2-91b6-42eb-9f98-44ca5df3a4f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:33.170973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:33.173013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:33.175497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:33.175497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:33.175497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:33.175497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:33.175497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:33.175497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:33.175497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:33.175497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:33.175497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:09:33.175497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:33.175497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 268/550] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:33.179282 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df002f-8de4-4a51-a9f6-8bc71a834790 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:33.289963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:33.313046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df002f-8de4-4a51-a9f6-8bc71a834790 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:33.359761 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423049f9-6795-4368-85cb-dd38ae650f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:33.360302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423049f9-6795-4368-85cb-dd38ae650f72 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:33.360581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423049f9-6795-4368-85cb-dd38ae650f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:33.360857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423049f9-6795-4368-85cb-dd38ae650f72 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:33.361584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423049f9-6795-4368-85cb-dd38ae650f72 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:33.361888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423049f9-6795-4368-85cb-dd38ae650f72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:33.363362 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423049f9-6795-4368-85cb-dd38ae650f72 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:33.389366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 283/551] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 19 15:09:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:33.390659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bb3a2-91b6-42eb-9f98-44ca5df3a4f7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:33.425719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423049f9-6795-4368-85cb-dd38ae650f72 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:33.549141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423049f9-6795-4368-85cb-dd38ae650f72 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:33.584769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3305fe5-4ed7-4322-8d71-0868fd31c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:33.585403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3305fe5-4ed7-4322-8d71-0868fd31c9db None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:33.585687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3305fe5-4ed7-4322-8d71-0868fd31c9db None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:33.585958 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3305fe5-4ed7-4322-8d71-0868fd31c9db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:33.587906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bb3a2-91b6-42eb-9f98-44ca5df3a4f7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:33.597234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3305fe5-4ed7-4322-8d71-0868fd31c9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c3305fe5-4ed7-4322-8d71-0868fd31c9db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:33.602106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:33.602998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:33.603955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 284/552] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:33.606361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:33.614120 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3305fe5-4ed7-4322-8d71-0868fd31c9db None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:33.648450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5b8d8-b06b-42f5-9df3-6a10ecf1223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:33.649512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5b8d8-b06b-42f5-9df3-6a10ecf1223a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:33.650076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5b8d8-b06b-42f5-9df3-6a10ecf1223a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:33.650595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5b8d8-b06b-42f5-9df3-6a10ecf1223a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:33.727266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3305fe5-4ed7-4322-8d71-0868fd31c9db None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:33.756484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:33.759241 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5b8d8-b06b-42f5-9df3-6a10ecf1223a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:33.761157 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5b8d8-b06b-42f5-9df3-6a10ecf1223a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:33.765377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851b819-351b-4516-978b-ab314cbc9336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:33.766004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851b819-351b-4516-978b-ab314cbc9336 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:33.766311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851b819-351b-4516-978b-ab314cbc9336 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:33.766585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851b819-351b-4516-978b-ab314cbc9336 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:33.767253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851b819-351b-4516-978b-ab314cbc9336 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:33.767555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851b819-351b-4516-978b-ab314cbc9336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:33.768917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851b819-351b-4516-978b-ab314cbc9336 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:33.778507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 285/553] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:33.779771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee3ad-a1e3-4d3d-9469-07168e569e21 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:33.780061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee3ad-a1e3-4d3d-9469-07168e569e21 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:33.780338 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee3ad-a1e3-4d3d-9469-07168e569e21 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:33.782066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 286/554] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:33.786752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee3ad-a1e3-4d3d-9469-07168e569e21 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:33.856288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:33.880663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 269/555] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:33.882168 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f64d9-3bad-4de9-a8c8-435920604a3e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:33.882666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f64d9-3bad-4de9-a8c8-435920604a3e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:33.883138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f64d9-3bad-4de9-a8c8-435920604a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:33.901466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9c1f64d9-3bad-4de9-a8c8-435920604a3e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:33.901755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee3ad-a1e3-4d3d-9469-07168e569e21 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:33.902681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9c1f64d9-3bad-4de9-a8c8-435920604a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:33.937974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b962a6-418a-4de1-81f4-cd866ad99ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:33.938652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b962a6-418a-4de1-81f4-cd866ad99ccb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:33.938938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b962a6-418a-4de1-81f4-cd866ad99ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:33.939210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b962a6-418a-4de1-81f4-cd866ad99ccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:33.950948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b962a6-418a-4de1-81f4-cd866ad99ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:33.952425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b962a6-418a-4de1-81f4-cd866ad99ccb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-26b962a6-418a-4de1-81f4-cd866ad99ccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:33.970978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:33.972103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:33.972963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:33.972963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:33.972963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:33.972963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 287/556] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:33.973352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d9383-6bff-4429-b967-4708fe40662e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:33.973639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d9383-6bff-4429-b967-4708fe40662e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:33.973910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d9383-6bff-4429-b967-4708fe40662e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:33.975127 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 270/557] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:33.978251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 288/558] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:33.978251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d9383-6bff-4429-b967-4708fe40662e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:33.980706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7fbd0-3b47-4f39-8543-c3cf72f39ec4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:33.980999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7fbd0-3b47-4f39-8543-c3cf72f39ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:33.981806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7fbd0-3b47-4f39-8543-c3cf72f39ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:33.999720 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-87e7fbd0-3b47-4f39-8543-c3cf72f39ec4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:34.000913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-87e7fbd0-3b47-4f39-8543-c3cf72f39ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:34.026729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:34.090169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 271/559] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:09:34.091342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7fbd0-3b47-4f39-8543-c3cf72f39ec4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:34.105178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d9383-6bff-4429-b967-4708fe40662e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:34.132208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:34.170778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43e093-dd40-4311-9e35-9cb51786df8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:34.171426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43e093-dd40-4311-9e35-9cb51786df8b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:34.171710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43e093-dd40-4311-9e35-9cb51786df8b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:34.171986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43e093-dd40-4311-9e35-9cb51786df8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:34.195121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43e093-dd40-4311-9e35-9cb51786df8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:34.196771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43e093-dd40-4311-9e35-9cb51786df8b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5d43e093-dd40-4311-9e35-9cb51786df8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:34.220168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:34.221789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:34.222985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:34.222985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:34.222985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:34.226386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 289/560] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:34.227369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43e093-dd40-4311-9e35-9cb51786df8b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:34.262395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7fbd0-3b47-4f39-8543-c3cf72f39ec4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:34.310895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457301d9-6971-4222-ba59-1e37abc4a0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:34.312230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457301d9-6971-4222-ba59-1e37abc4a0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:34.312763 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457301d9-6971-4222-ba59-1e37abc4a0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:34.313183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457301d9-6971-4222-ba59-1e37abc4a0d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:34.314156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457301d9-6971-4222-ba59-1e37abc4a0d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:34.314923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457301d9-6971-4222-ba59-1e37abc4a0d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:34.316799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457301d9-6971-4222-ba59-1e37abc4a0d3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:34.334400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 272/561] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:34.335506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457301d9-6971-4222-ba59-1e37abc4a0d3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:34.360076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43e093-dd40-4311-9e35-9cb51786df8b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:34.364910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:34.397549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc7fea-6916-4f03-9d9f-d39a2780713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:34.398312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7fea-6916-4f03-9d9f-d39a2780713f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:34.398694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7fea-6916-4f03-9d9f-d39a2780713f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:34.399068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc7fea-6916-4f03-9d9f-d39a2780713f None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:34.399945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc7fea-6916-4f03-9d9f-d39a2780713f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:34.400554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc7fea-6916-4f03-9d9f-d39a2780713f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:34.401918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc7fea-6916-4f03-9d9f-d39a2780713f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:34.414934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 290/562] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:34.415588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc7fea-6916-4f03-9d9f-d39a2780713f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:34.444429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:34.460131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457301d9-6971-4222-ba59-1e37abc4a0d3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:34.496427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b4c5b-17c1-4d0a-a029-9e418731bd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:34.497627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b4c5b-17c1-4d0a-a029-9e418731bd71 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:34.497907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b4c5b-17c1-4d0a-a029-9e418731bd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:34.498207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b4c5b-17c1-4d0a-a029-9e418731bd71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:34.508677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b4c5b-17c1-4d0a-a029-9e418731bd71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fe3b4c5b-17c1-4d0a-a029-9e418731bd71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:34.513854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:34.514792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:34.515608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 273/563] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:34.516315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b4c5b-17c1-4d0a-a029-9e418731bd71 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:34.527623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc7fea-6916-4f03-9d9f-d39a2780713f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:34.567173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8a9a-e1ab-4a08-84d8-9850c0bff3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:34.567810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8a9a-e1ab-4a08-84d8-9850c0bff3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:34.568089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8a9a-e1ab-4a08-84d8-9850c0bff3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:34.568360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8a9a-e1ab-4a08-84d8-9850c0bff3b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:34.576212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba8a9a-e1ab-4a08-84d8-9850c0bff3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:34.577644 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba8a9a-e1ab-4a08-84d8-9850c0bff3b2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0dba8a9a-e1ab-4a08-84d8-9850c0bff3b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:34.590174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:34.591793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 291/564] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 19 15:09:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:34.593290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8a9a-e1ab-4a08-84d8-9850c0bff3b2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:34.608992 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:34.630625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b4c5b-17c1-4d0a-a029-9e418731bd71 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:34.668576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81a0b4-ac27-47bc-8d3f-ba977457937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:34.670157 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81a0b4-ac27-47bc-8d3f-ba977457937c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:34.670157 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81a0b4-ac27-47bc-8d3f-ba977457937c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:34.670331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81a0b4-ac27-47bc-8d3f-ba977457937c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:34.681695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81a0b4-ac27-47bc-8d3f-ba977457937c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:34.685488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bd81a0b4-ac27-47bc-8d3f-ba977457937c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:34.686818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:34.687751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:34.688633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:34.692974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 274/565] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:34.693698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81a0b4-ac27-47bc-8d3f-ba977457937c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:34.704129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8a9a-e1ab-4a08-84d8-9850c0bff3b2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:34.743264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2f0cc-21c3-4283-8326-734cccc54e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:34.743895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f0cc-21c3-4283-8326-734cccc54e9e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:34.744177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f0cc-21c3-4283-8326-734cccc54e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:34.744449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f0cc-21c3-4283-8326-734cccc54e9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:34.753554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2f0cc-21c3-4283-8326-734cccc54e9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:34.753554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2f0cc-21c3-4283-8326-734cccc54e9e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0cc2f0cc-21c3-4283-8326-734cccc54e9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:34.765375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:34.766323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:34.767224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:34.767224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:34.767224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:34.767224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:34.767224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:34.767224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:34.767224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:34.767224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:34.767224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 292/566] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:34.767224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2f0cc-21c3-4283-8326-734cccc54e9e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:34.805971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81a0b4-ac27-47bc-8d3f-ba977457937c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:34.838549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc552efa-9e7c-48e1-928a-35a919ce3913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:34.839154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc552efa-9e7c-48e1-928a-35a919ce3913 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:34.839437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc552efa-9e7c-48e1-928a-35a919ce3913 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:34.839710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc552efa-9e7c-48e1-928a-35a919ce3913 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:34.841199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc552efa-9e7c-48e1-928a-35a919ce3913 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:34.841505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc552efa-9e7c-48e1-928a-35a919ce3913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:34.842919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc552efa-9e7c-48e1-928a-35a919ce3913 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:34.851075 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 275/567] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:34.851859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc552efa-9e7c-48e1-928a-35a919ce3913 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:34.854567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:34.872188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2f0cc-21c3-4283-8326-734cccc54e9e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:34.905734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dbe0c-d17c-498e-96f7-4311525b5b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:34.906375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dbe0c-d17c-498e-96f7-4311525b5b80 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:34.906658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dbe0c-d17c-498e-96f7-4311525b5b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:34.906936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dbe0c-d17c-498e-96f7-4311525b5b80 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:34.907668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dbe0c-d17c-498e-96f7-4311525b5b80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:34.907980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dbe0c-d17c-498e-96f7-4311525b5b80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:34.909417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3dbe0c-d17c-498e-96f7-4311525b5b80 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:34.926726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 293/568] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 19 15:09:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:34.927447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dbe0c-d17c-498e-96f7-4311525b5b80 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:34.932214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:34.951741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc552efa-9e7c-48e1-928a-35a919ce3913 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:34.984691 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016179a-0f5a-458c-9a17-015790f6a5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:34.985295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016179a-0f5a-458c-9a17-015790f6a5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:34.985578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016179a-0f5a-458c-9a17-015790f6a5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:34.985851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016179a-0f5a-458c-9a17-015790f6a5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:34.986580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016179a-0f5a-458c-9a17-015790f6a5d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:34.986883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016179a-0f5a-458c-9a17-015790f6a5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:34.988248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016179a-0f5a-458c-9a17-015790f6a5d6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:34.995893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 276/569] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:34.997051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb8433-b188-4fa9-8506-32978c9ff853 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:34.997339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb8433-b188-4fa9-8506-32978c9ff853 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:34.998191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb8433-b188-4fa9-8506-32978c9ff853 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.002156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 277/570] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:35.002156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb8433-b188-4fa9-8506-32978c9ff853 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:35.028726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dbe0c-d17c-498e-96f7-4311525b5b80 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:35.062325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34f743-9e81-4d09-b761-780ef86f4f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:35.062929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34f743-9e81-4d09-b761-780ef86f4f75 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:35.063216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34f743-9e81-4d09-b761-780ef86f4f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:35.063509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34f743-9e81-4d09-b761-780ef86f4f75 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.064076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:35.064192 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34f743-9e81-4d09-b761-780ef86f4f75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:35.064475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34f743-9e81-4d09-b761-780ef86f4f75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:35.066070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34f743-9e81-4d09-b761-780ef86f4f75 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:35.077151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 294/571] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:35.077927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34f743-9e81-4d09-b761-780ef86f4f75 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:35.107226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb8433-b188-4fa9-8506-32978c9ff853 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:35.137563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:35.141118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a557d38-b774-44f5-93a0-53314dd95c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:35.141742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a557d38-b774-44f5-93a0-53314dd95c6a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:35.142021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a557d38-b774-44f5-93a0-53314dd95c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:35.142316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a557d38-b774-44f5-93a0-53314dd95c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.152330 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a557d38-b774-44f5-93a0-53314dd95c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:35.153794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a557d38-b774-44f5-93a0-53314dd95c6a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8a557d38-b774-44f5-93a0-53314dd95c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:35.170587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:35.171638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:35.172523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:35.172523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:35.172523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:35.172523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 278/572] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:35.172523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a557d38-b774-44f5-93a0-53314dd95c6a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:35.179963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34f743-9e81-4d09-b761-780ef86f4f75 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:35.212962 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b2628-2f47-4414-ac99-3ffff2c3eb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:35.213581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b2628-2f47-4414-ac99-3ffff2c3eb2f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:35.213864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b2628-2f47-4414-ac99-3ffff2c3eb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:35.214179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b2628-2f47-4414-ac99-3ffff2c3eb2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.224475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b2628-2f47-4414-ac99-3ffff2c3eb2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:35.226155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b2628-2f47-4414-ac99-3ffff2c3eb2f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ca8b2628-2f47-4414-ac99-3ffff2c3eb2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:35.240660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:35.241749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:35.242844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:35.242844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:35.242844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:35.242844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 295/573] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:35.243159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63285e-8d95-4769-b9ac-835c619c607b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:35.243446 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63285e-8d95-4769-b9ac-835c619c607b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:35.243705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63285e-8d95-4769-b9ac-835c619c607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.261060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1f63285e-8d95-4769-b9ac-835c619c607b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:35.262791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1f63285e-8d95-4769-b9ac-835c619c607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:35.275736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a557d38-b774-44f5-93a0-53314dd95c6a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:35.291884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:35.310268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e9446-87d8-4b30-95c2-50892faa9b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:35.310887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9446-87d8-4b30-95c2-50892faa9b43 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:35.311163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9446-87d8-4b30-95c2-50892faa9b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:35.311433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9446-87d8-4b30-95c2-50892faa9b43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.321765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e9446-87d8-4b30-95c2-50892faa9b43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:35.323230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e9446-87d8-4b30-95c2-50892faa9b43 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:35.328277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 296/574] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:35.328919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63285e-8d95-4769-b9ac-835c619c607b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-9b2e9446-87d8-4b30-95c2-50892faa9b43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:35.343017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:35.343932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:35.344853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:35.344853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:35.344853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:35.344853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 279/575] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:35.345072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e9446-87d8-4b30-95c2-50892faa9b43 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:35.379923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:35.437949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63285e-8d95-4769-b9ac-835c619c607b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:35.447565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e9446-87d8-4b30-95c2-50892faa9b43 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:35.473811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89abf9c-a6e2-486b-9e1d-2e0359ce7a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:35.474544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89abf9c-a6e2-486b-9e1d-2e0359ce7a6d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:35.474831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89abf9c-a6e2-486b-9e1d-2e0359ce7a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:35.475106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89abf9c-a6e2-486b-9e1d-2e0359ce7a6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.475831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89abf9c-a6e2-486b-9e1d-2e0359ce7a6d None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=62c25756d0814f1dbb8ca210ae34c892) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:35.476142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89abf9c-a6e2-486b-9e1d-2e0359ce7a6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:35.477567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89abf9c-a6e2-486b-9e1d-2e0359ce7a6d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:35.483907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 297/576] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:35 2022] GET /identity/v3/role_assignments?user.id=62c25756d0814f1dbb8ca210ae34c892&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:35.484123 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd2369-0f31-45b6-b4bc-bf814208b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:35.484721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89abf9c-a6e2-486b-9e1d-2e0359ce7a6d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:35.485411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd2369-0f31-45b6-b4bc-bf814208b39a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:35.485694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd2369-0f31-45b6-b4bc-bf814208b39a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:35.485987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd2369-0f31-45b6-b4bc-bf814208b39a None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.486686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd2369-0f31-45b6-b4bc-bf814208b39a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:35.486990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd2369-0f31-45b6-b4bc-bf814208b39a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:35.488363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd2369-0f31-45b6-b4bc-bf814208b39a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:35.507103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 280/577] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:35.509568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd2369-0f31-45b6-b4bc-bf814208b39a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:35.544575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:35.620086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89abf9c-a6e2-486b-9e1d-2e0359ce7a6d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:35.627223 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd2369-0f31-45b6-b4bc-bf814208b39a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:35.632303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:35.658701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d924f1c-adaa-4427-b9e6-5f83448a4d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:35.659305 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924f1c-adaa-4427-b9e6-5f83448a4d06 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:35.659597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924f1c-adaa-4427-b9e6-5f83448a4d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:35.659857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d924f1c-adaa-4427-b9e6-5f83448a4d06 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.660498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d924f1c-adaa-4427-b9e6-5f83448a4d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:35.660800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d924f1c-adaa-4427-b9e6-5f83448a4d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:35.662200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d924f1c-adaa-4427-b9e6-5f83448a4d06 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:35.672065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdd5df-4dab-493b-8c43-468c96745da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:35.672677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdd5df-4dab-493b-8c43-468c96745da6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:35.672963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdd5df-4dab-493b-8c43-468c96745da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:35.673242 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdd5df-4dab-493b-8c43-468c96745da6 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.673876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdd5df-4dab-493b-8c43-468c96745da6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:35.674215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdd5df-4dab-493b-8c43-468c96745da6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:35.679573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 298/578] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:35.679734 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdd5df-4dab-493b-8c43-468c96745da6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:35.679816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d924f1c-adaa-4427-b9e6-5f83448a4d06 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:35.688032 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 281/579] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:35.688805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdd5df-4dab-493b-8c43-468c96745da6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:35.784155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:35.789263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d924f1c-adaa-4427-b9e6-5f83448a4d06 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:35.799917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdd5df-4dab-493b-8c43-468c96745da6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:35.826432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cbc33-34bd-4bb8-8003-c660c0366c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:35.827061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cbc33-34bd-4bb8-8003-c660c0366c09 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:35.827342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cbc33-34bd-4bb8-8003-c660c0366c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:35.827614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cbc33-34bd-4bb8-8003-c660c0366c09 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.835638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cbc33-34bd-4bb8-8003-c660c0366c09 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:35.837075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cbc33-34bd-4bb8-8003-c660c0366c09 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:35.837721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bc198-e75b-46f0-b1f5-0275e8c50cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:35.838549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bc198-e75b-46f0-b1f5-0275e8c50cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:35.838985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bc198-e75b-46f0-b1f5-0275e8c50cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:35.839407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bc198-e75b-46f0-b1f5-0275e8c50cf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-aa0cbc33-34bd-4bb8-8003-c660c0366c09 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:35.849081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:35.850193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:35.851318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:35.851318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:35.851318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:35.851318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:35.851318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:35.851318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:35.851318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:35.851318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:35.851318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:09:35.851318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:35.853542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bc198-e75b-46f0-b1f5-0275e8c50cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:35.855016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 299/580] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:35.855900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cbc33-34bd-4bb8-8003-c660c0366c09 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-577bc198-e75b-46f0-b1f5-0275e8c50cf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:35.860506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:35.861679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:35.862726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:35.864919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 282/581] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:35.865837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bc198-e75b-46f0-b1f5-0275e8c50cf6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:35.890384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:35.972265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bc198-e75b-46f0-b1f5-0275e8c50cf6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:35.972621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cbc33-34bd-4bb8-8003-c660c0366c09 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:36.007283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efb19f-065d-44b6-906f-64857e588a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.008048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efb19f-065d-44b6-906f-64857e588a7d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.008186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf59ea1-1dbe-42b1-a0d4-8dc95aaca873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.008519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efb19f-065d-44b6-906f-64857e588a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.008864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59ea1-1dbe-42b1-a0d4-8dc95aaca873 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.008969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efb19f-065d-44b6-906f-64857e588a7d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.009147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59ea1-1dbe-42b1-a0d4-8dc95aaca873 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.009417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf59ea1-1dbe-42b1-a0d4-8dc95aaca873 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.017645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efb19f-065d-44b6-906f-64857e588a7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.017781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf59ea1-1dbe-42b1-a0d4-8dc95aaca873 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.019156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf59ea1-1dbe-42b1-a0d4-8dc95aaca873 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.019442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efb19f-065d-44b6-906f-64857e588a7d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-33efb19f-065d-44b6-906f-64857e588a7d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:36.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:36.032517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:36.033669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:36.033669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:36.033669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:36.033669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:36.033669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:36.033669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:36.033669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:36.033669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:36.033669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:09:36.033669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-abf59ea1-1dbe-42b1-a0d4-8dc95aaca873 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:36.034366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:36.035323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:36.036384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:36.036384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:36.036384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:36.036384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:36.036384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:36.036384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:36.036384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:36.036384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:36.036923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 283/582] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:36.037265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efb19f-065d-44b6-906f-64857e588a7d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:36.037987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 300/583] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:36.038941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf59ea1-1dbe-42b1-a0d4-8dc95aaca873 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:36.053582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:36.133750 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:36.145561 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf59ea1-1dbe-42b1-a0d4-8dc95aaca873 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:36.152995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efb19f-065d-44b6-906f-64857e588a7d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:36.180038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5e67b-1dcc-4176-a8cd-8449b33b7dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.180779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5e67b-1dcc-4176-a8cd-8449b33b7dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.181059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5e67b-1dcc-4176-a8cd-8449b33b7dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.181400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5e67b-1dcc-4176-a8cd-8449b33b7dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.182187 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5e67b-1dcc-4176-a8cd-8449b33b7dd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:36.182554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5e67b-1dcc-4176-a8cd-8449b33b7dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.184541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5e67b-1dcc-4176-a8cd-8449b33b7dd0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.188323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc6dc7-28de-4b65-a0d3-95e2c72aef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.188920 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc6dc7-28de-4b65-a0d3-95e2c72aef2a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.189203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc6dc7-28de-4b65-a0d3-95e2c72aef2a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.189476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc6dc7-28de-4b65-a0d3-95e2c72aef2a None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.190240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc6dc7-28de-4b65-a0d3-95e2c72aef2a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:36.190547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc6dc7-28de-4b65-a0d3-95e2c72aef2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.191955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc6dc7-28de-4b65-a0d3-95e2c72aef2a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.197396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 301/584] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:36.197396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5e67b-1dcc-4176-a8cd-8449b33b7dd0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:36.218801 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 284/585] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 19 15:09:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:36.219908 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc6dc7-28de-4b65-a0d3-95e2c72aef2a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:36.289630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:36.300082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5e67b-1dcc-4176-a8cd-8449b33b7dd0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:36.326903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc6dc7-28de-4b65-a0d3-95e2c72aef2a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:36.335251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea2c42-685c-4bf6-86af-19a7523d0e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.335864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea2c42-685c-4bf6-86af-19a7523d0e0d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.336146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea2c42-685c-4bf6-86af-19a7523d0e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.336418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea2c42-685c-4bf6-86af-19a7523d0e0d None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.337145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea2c42-685c-4bf6-86af-19a7523d0e0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:36.337452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea2c42-685c-4bf6-86af-19a7523d0e0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.338924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea2c42-685c-4bf6-86af-19a7523d0e0d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.356711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 302/586] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 19 15:09:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:36.358920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea2c42-685c-4bf6-86af-19a7523d0e0d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:36.366207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46258423-f431-48c0-8cbf-2ab3c4a9cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.366818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46258423-f431-48c0-8cbf-2ab3c4a9cd6f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.367093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46258423-f431-48c0-8cbf-2ab3c4a9cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.367782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46258423-f431-48c0-8cbf-2ab3c4a9cd6f None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.368481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46258423-f431-48c0-8cbf-2ab3c4a9cd6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:36.368790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46258423-f431-48c0-8cbf-2ab3c4a9cd6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.370712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:36.370932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46258423-f431-48c0-8cbf-2ab3c4a9cd6f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.384175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 285/587] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:36.390244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46258423-f431-48c0-8cbf-2ab3c4a9cd6f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:36.463634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea2c42-685c-4bf6-86af-19a7523d0e0d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:36.500022 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ad572-be43-430c-9382-4cc14ff067b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.500662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46258423-f431-48c0-8cbf-2ab3c4a9cd6f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:36.501001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ad572-be43-430c-9382-4cc14ff067b4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.501001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ad572-be43-430c-9382-4cc14ff067b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.501169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ad572-be43-430c-9382-4cc14ff067b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.511705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ad572-be43-430c-9382-4cc14ff067b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.513150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ad572-be43-430c-9382-4cc14ff067b4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d99ad572-be43-430c-9382-4cc14ff067b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:36.530480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:36.531468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:36.532349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:36.532349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:36.532349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:36.532349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 303/588] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:36.532349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ad572-be43-430c-9382-4cc14ff067b4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:36.537288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:36.548970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218cc67-1e28-4e9c-83a1-22e95fe18464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.550247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218cc67-1e28-4e9c-83a1-22e95fe18464 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.551220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218cc67-1e28-4e9c-83a1-22e95fe18464 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.552081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218cc67-1e28-4e9c-83a1-22e95fe18464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.566292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218cc67-1e28-4e9c-83a1-22e95fe18464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.567793 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218cc67-1e28-4e9c-83a1-22e95fe18464 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2218cc67-1e28-4e9c-83a1-22e95fe18464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:36.582047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:36.582952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:36.583826 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:36.583826 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:36.583826 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:36.583826 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 286/589] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:36.584057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218cc67-1e28-4e9c-83a1-22e95fe18464 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:36.608576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:36.651400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ad572-be43-430c-9382-4cc14ff067b4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:36.690997 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218cc67-1e28-4e9c-83a1-22e95fe18464 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:36.691184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e412cc-4719-453b-b5c8-d348cd67073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.691651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e412cc-4719-453b-b5c8-d348cd67073f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.691930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e412cc-4719-453b-b5c8-d348cd67073f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.692201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e412cc-4719-453b-b5c8-d348cd67073f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.704273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e412cc-4719-453b-b5c8-d348cd67073f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.705712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e412cc-4719-453b-b5c8-d348cd67073f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-86e412cc-4719-453b-b5c8-d348cd67073f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:36.719758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:36.720718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:36.721604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:36.721604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:36.721604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:36.721604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 304/590] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:36.721604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e412cc-4719-453b-b5c8-d348cd67073f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:36.735039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a19654-c86e-4741-a7ce-8b794132a28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.735520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19654-c86e-4741-a7ce-8b794132a28b None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.735800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19654-c86e-4741-a7ce-8b794132a28b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.736074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a19654-c86e-4741-a7ce-8b794132a28b None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/a86ca59cbf894c508b3439b08715da86/roles/07f9b55cf8dc408984d3e199f474cb91` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.751335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a19654-c86e-4741-a7ce-8b794132a28b None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=a86ca59cbf894c508b3439b08715da86, role_id=07f9b55cf8dc408984d3e199f474cb91)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.752762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a19654-c86e-4741-a7ce-8b794132a28b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.765325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 287/591] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:09:36 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/a86ca59cbf894c508b3439b08715da86/roles/07f9b55cf8dc408984d3e199f474cb91 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:09:36.766160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a19654-c86e-4741-a7ce-8b794132a28b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:36.805403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:36.862843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e412cc-4719-453b-b5c8-d348cd67073f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:36.883248 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:36.896854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a19654-c86e-4741-a7ce-8b794132a28b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:36.913063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f91d9-1f5b-44cb-be6e-8a76228235e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.914141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f91d9-1f5b-44cb-be6e-8a76228235e2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.914522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f91d9-1f5b-44cb-be6e-8a76228235e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.914918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f91d9-1f5b-44cb-be6e-8a76228235e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.916349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f91d9-1f5b-44cb-be6e-8a76228235e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:36.916789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f91d9-1f5b-44cb-be6e-8a76228235e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.919766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f91d9-1f5b-44cb-be6e-8a76228235e2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.939504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 305/592] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:36.940639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f91d9-1f5b-44cb-be6e-8a76228235e2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:36.944104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca4bf-a91d-45fb-a5d4-d704b0495881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:36.945631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca4bf-a91d-45fb-a5d4-d704b0495881 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:36.945919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca4bf-a91d-45fb-a5d4-d704b0495881 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:36.946216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfca4bf-a91d-45fb-a5d4-d704b0495881 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:36.946879 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfca4bf-a91d-45fb-a5d4-d704b0495881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:36.947184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfca4bf-a91d-45fb-a5d4-d704b0495881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:36.948557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfca4bf-a91d-45fb-a5d4-d704b0495881 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:36.962583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 288/593] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:36.963429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca4bf-a91d-45fb-a5d4-d704b0495881 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:37.062608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:37.074275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfca4bf-a91d-45fb-a5d4-d704b0495881 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:37.079162 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f91d9-1f5b-44cb-be6e-8a76228235e2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:37.116641 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c692c7-01a9-4d49-a850-e36009b52d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:37.117294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c692c7-01a9-4d49-a850-e36009b52d67 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.117632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c692c7-01a9-4d49-a850-e36009b52d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.117908 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c692c7-01a9-4d49-a850-e36009b52d67 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.128546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c692c7-01a9-4d49-a850-e36009b52d67 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:37.130179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c692c7-01a9-4d49-a850-e36009b52d67 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:37.131637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11ff87-892f-4b3b-a005-0c4f59186a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:37.133222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ff87-892f-4b3b-a005-0c4f59186a9f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.133712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ff87-892f-4b3b-a005-0c4f59186a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.134210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ff87-892f-4b3b-a005-0c4f59186a9f None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.135032 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11ff87-892f-4b3b-a005-0c4f59186a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:37.135533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11ff87-892f-4b3b-a005-0c4f59186a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:37.137389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11ff87-892f-4b3b-a005-0c4f59186a9f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d1c692c7-01a9-4d49-a850-e36009b52d67 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:37.142319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:37.143234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:37.144426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:37.144426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:37.144426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:37.144426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:37.144426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:37.144426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:37.144426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:37.144426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:37.144426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:09:37.144426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:37.144426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 289/594] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:37.145766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c692c7-01a9-4d49-a850-e36009b52d67 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:37.155210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 306/595] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:37.156322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11ff87-892f-4b3b-a005-0c4f59186a9f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:37.204782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:37.261693 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c692c7-01a9-4d49-a850-e36009b52d67 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:37.278816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11ff87-892f-4b3b-a005-0c4f59186a9f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:37.298319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f3b53-b248-4ed2-94e8-5684cb7317ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:37.299095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f3b53-b248-4ed2-94e8-5684cb7317ad None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.299474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f3b53-b248-4ed2-94e8-5684cb7317ad None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.299914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f3b53-b248-4ed2-94e8-5684cb7317ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.307745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f3b53-b248-4ed2-94e8-5684cb7317ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:37.309408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f3b53-b248-4ed2-94e8-5684cb7317ad None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:37.316466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3c38b-4c8c-43bc-9c3f-08f7ef965c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:37.317313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c38b-4c8c-43bc-9c3f-08f7ef965c47 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.317739 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c38b-4c8c-43bc-9c3f-08f7ef965c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.318181 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3c38b-4c8c-43bc-9c3f-08f7ef965c47 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.319056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3c38b-4c8c-43bc-9c3f-08f7ef965c47 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:37.319528 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3c38b-4c8c-43bc-9c3f-08f7ef965c47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:37.321085 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3c38b-4c8c-43bc-9c3f-08f7ef965c47 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a00f3b53-b248-4ed2-94e8-5684cb7317ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:37.322156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:37.323004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:37.324101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:37.324101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:37.324101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:37.324101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:37.324101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:37.324101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:37.324101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:37.324101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:37.324101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 290/596] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:37.325389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f3b53-b248-4ed2-94e8-5684cb7317ad None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:37.337035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:37.343855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 307/597] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Aug 19 15:09:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:37.345205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3c38b-4c8c-43bc-9c3f-08f7ef965c47 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:37.433143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f3b53-b248-4ed2-94e8-5684cb7317ad None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:37.440235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:37.449547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3c38b-4c8c-43bc-9c3f-08f7ef965c47 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:37.469508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89aba-6012-4291-9cb1-981021d66644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:37.470422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89aba-6012-4291-9cb1-981021d66644 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.470422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89aba-6012-4291-9cb1-981021d66644 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.470697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d89aba-6012-4291-9cb1-981021d66644 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.477416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d89aba-6012-4291-9cb1-981021d66644 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:37.478880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d89aba-6012-4291-9cb1-981021d66644 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:37.485440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6787e-1bbb-4922-9185-a96c8cb5bde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:37.486061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6787e-1bbb-4922-9185-a96c8cb5bde2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.486345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6787e-1bbb-4922-9185-a96c8cb5bde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.486615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6787e-1bbb-4922-9185-a96c8cb5bde2 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.487300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6787e-1bbb-4922-9185-a96c8cb5bde2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:37.487603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6787e-1bbb-4922-9185-a96c8cb5bde2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:37.489003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6787e-1bbb-4922-9185-a96c8cb5bde2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f1d89aba-6012-4291-9cb1-981021d66644 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:37.490794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:37.491620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:37.492484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:37.492484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:37.492484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:37.492484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:37.492484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:37.492484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:37.492484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:37.492484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:37.492484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 291/598] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:37.493548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89aba-6012-4291-9cb1-981021d66644 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:37.507371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 308/599] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:37.508568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cfc90-1980-4763-bbf1-3631ab597a4e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.508848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cfc90-1980-4763-bbf1-3631ab597a4e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.509116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cfc90-1980-4763-bbf1-3631ab597a4e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.514302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 309/600] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:37.515048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cfc90-1980-4763-bbf1-3631ab597a4e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:37.573707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:37.609572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d89aba-6012-4291-9cb1-981021d66644 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:37.621844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cfc90-1980-4763-bbf1-3631ab597a4e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:37.645519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a489dc-61bf-4296-a4c4-276d080fe45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:37.646170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a489dc-61bf-4296-a4c4-276d080fe45a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.646449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a489dc-61bf-4296-a4c4-276d080fe45a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.646720 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a489dc-61bf-4296-a4c4-276d080fe45a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.656061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850240f-3209-4d34-9a58-c75dcdc97237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:37.656663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850240f-3209-4d34-9a58-c75dcdc97237 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.656936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850240f-3209-4d34-9a58-c75dcdc97237 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.657209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850240f-3209-4d34-9a58-c75dcdc97237 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.657903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850240f-3209-4d34-9a58-c75dcdc97237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:37.658242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850240f-3209-4d34-9a58-c75dcdc97237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:37.659453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a489dc-61bf-4296-a4c4-276d080fe45a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:37.659673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850240f-3209-4d34-9a58-c75dcdc97237 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:37.661267 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a489dc-61bf-4296-a4c4-276d080fe45a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:37.671683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 310/601] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:37.672435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850240f-3209-4d34-9a58-c75dcdc97237 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-c5a489dc-61bf-4296-a4c4-276d080fe45a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:37.676621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:37.677520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:37.678497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:37.678497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:37.678497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:37.679924 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 292/602] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:37.681213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0703b5-c688-4218-8053-817051057db5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.681689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0703b5-c688-4218-8053-817051057db5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.682132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0703b5-c688-4218-8053-817051057db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.695546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:37.700042 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ab0703b5-c688-4218-8053-817051057db5 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:37.701236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ab0703b5-c688-4218-8053-817051057db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:37.778251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 293/603] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:37.778251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0703b5-c688-4218-8053-817051057db5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:37.784521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850240f-3209-4d34-9a58-c75dcdc97237 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:37.820310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d24a6-81db-4260-9d98-c79b34e1023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:37.820961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d24a6-81db-4260-9d98-c79b34e1023a None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.821240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d24a6-81db-4260-9d98-c79b34e1023a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.821508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d24a6-81db-4260-9d98-c79b34e1023a None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/895028dd70a0415595a0ff8ebedb1f0f/roles/07f9b55cf8dc408984d3e199f474cb91` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.839460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d24a6-81db-4260-9d98-c79b34e1023a None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=895028dd70a0415595a0ff8ebedb1f0f, role_id=07f9b55cf8dc408984d3e199f474cb91)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:37.841883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d24a6-81db-4260-9d98-c79b34e1023a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:37.845708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:37.862354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 311/604] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:09:37 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/895028dd70a0415595a0ff8ebedb1f0f/roles/07f9b55cf8dc408984d3e199f474cb91 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:09:37.863174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d24a6-81db-4260-9d98-c79b34e1023a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:37.905160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0703b5-c688-4218-8053-817051057db5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:37.944630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0189c5-8af7-410c-9a7d-338e0c6fad94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:37.945772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0189c5-8af7-410c-9a7d-338e0c6fad94 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:37.946304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0189c5-8af7-410c-9a7d-338e0c6fad94 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:37.946799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0189c5-8af7-410c-9a7d-338e0c6fad94 None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/c23bb3a6586247e0a11ece33569d6d69/roles/07f9b55cf8dc408984d3e199f474cb91` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:37.964214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0189c5-8af7-410c-9a7d-338e0c6fad94 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=c23bb3a6586247e0a11ece33569d6d69, role_id=07f9b55cf8dc408984d3e199f474cb91)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:37.966412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:37.966958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0189c5-8af7-410c-9a7d-338e0c6fad94 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:37.983835 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 294/605] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:09:37 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/c23bb3a6586247e0a11ece33569d6d69/roles/07f9b55cf8dc408984d3e199f474cb91 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:09:37.993455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d24a6-81db-4260-9d98-c79b34e1023a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:38.035289 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225390-b20b-4bc0-9dca-6e8f71064265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:38.036318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225390-b20b-4bc0-9dca-6e8f71064265 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:38.036796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225390-b20b-4bc0-9dca-6e8f71064265 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:38.037268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d225390-b20b-4bc0-9dca-6e8f71064265 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:38.038211 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225390-b20b-4bc0-9dca-6e8f71064265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:38.038859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225390-b20b-4bc0-9dca-6e8f71064265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:38.040625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d225390-b20b-4bc0-9dca-6e8f71064265 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:38.054591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 312/606] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:38.062233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0189c5-8af7-410c-9a7d-338e0c6fad94 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:38.193751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:38.200715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225390-b20b-4bc0-9dca-6e8f71064265 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:38.201631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0189c5-8af7-410c-9a7d-338e0c6fad94 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:38.243397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a53fba-4cec-4ff1-9d9d-a45f033c67ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:38.244031 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a53fba-4cec-4ff1-9d9d-a45f033c67ef None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:38.244314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a53fba-4cec-4ff1-9d9d-a45f033c67ef None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:38.244583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a53fba-4cec-4ff1-9d9d-a45f033c67ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:38.252420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a53fba-4cec-4ff1-9d9d-a45f033c67ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:38.254456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a53fba-4cec-4ff1-9d9d-a45f033c67ef None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d0a53fba-4cec-4ff1-9d9d-a45f033c67ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:38.268752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:38.269677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:38.270570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:38.270570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:38.270570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:38.270570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:38.270570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:38.270570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:38.270570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:38.270570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:38.270570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 295/607] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:38.279338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a53fba-4cec-4ff1-9d9d-a45f033c67ef None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:38.352298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d225390-b20b-4bc0-9dca-6e8f71064265 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:38.376636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:38.402264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef50be-fc22-4c43-a040-029c536f3102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:38.402955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef50be-fc22-4c43-a040-029c536f3102 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:38.403242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef50be-fc22-4c43-a040-029c536f3102 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:38.403516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef50be-fc22-4c43-a040-029c536f3102 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:38.427174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef50be-fc22-4c43-a040-029c536f3102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-59ef50be-fc22-4c43-a040-029c536f3102 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:38.436747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:38.437768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:38.438622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:38.441407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a53fba-4cec-4ff1-9d9d-a45f033c67ef None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:38.448525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 313/608] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:38.449356 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef50be-fc22-4c43-a040-029c536f3102 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:38.503994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae536be-119b-4789-a1ef-36f73abd3e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:38.504610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae536be-119b-4789-a1ef-36f73abd3e1e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:38.504889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae536be-119b-4789-a1ef-36f73abd3e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:38.505162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae536be-119b-4789-a1ef-36f73abd3e1e None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:38.505866 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae536be-119b-4789-a1ef-36f73abd3e1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:38.506198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae536be-119b-4789-a1ef-36f73abd3e1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:38.507631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae536be-119b-4789-a1ef-36f73abd3e1e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:38.534302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 296/609] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:38.539295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae536be-119b-4789-a1ef-36f73abd3e1e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:38.566552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:38.633492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef50be-fc22-4c43-a040-029c536f3102 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:38.649126 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae536be-119b-4789-a1ef-36f73abd3e1e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:38.684824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c2ade-b25a-4e9c-997d-cf1fa4d054c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:38.685489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c2ade-b25a-4e9c-997d-cf1fa4d054c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:38.685772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c2ade-b25a-4e9c-997d-cf1fa4d054c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:38.686066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c2ade-b25a-4e9c-997d-cf1fa4d054c6 None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/a220cf4fafe84d6498bc959a9cd18df7/roles/07f9b55cf8dc408984d3e199f474cb91` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:38.701676 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c2ade-b25a-4e9c-997d-cf1fa4d054c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=a220cf4fafe84d6498bc959a9cd18df7, role_id=07f9b55cf8dc408984d3e199f474cb91)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:38.703092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c2ade-b25a-4e9c-997d-cf1fa4d054c6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:38.703876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c774a9-7928-4a27-b54a-c2a5ad7af677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:38.704623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c774a9-7928-4a27-b54a-c2a5ad7af677 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:38.704997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c774a9-7928-4a27-b54a-c2a5ad7af677 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:38.705371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c774a9-7928-4a27-b54a-c2a5ad7af677 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:38.706177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c774a9-7928-4a27-b54a-c2a5ad7af677 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:38.706583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c774a9-7928-4a27-b54a-c2a5ad7af677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:38.708077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c774a9-7928-4a27-b54a-c2a5ad7af677 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:38.717057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 297/610] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:09:38 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/a220cf4fafe84d6498bc959a9cd18df7/roles/07f9b55cf8dc408984d3e199f474cb91 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:09:38.717698 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 314/611] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:38.723485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c2ade-b25a-4e9c-997d-cf1fa4d054c6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:38.802619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:38.838259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c2ade-b25a-4e9c-997d-cf1fa4d054c6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:38.876355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579230e-a702-4f9e-8329-29d6241249c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:38.877058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579230e-a702-4f9e-8329-29d6241249c4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:38.877340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579230e-a702-4f9e-8329-29d6241249c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:38.877613 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579230e-a702-4f9e-8329-29d6241249c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:38.889892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579230e-a702-4f9e-8329-29d6241249c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:38.891781 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579230e-a702-4f9e-8329-29d6241249c4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2579230e-a702-4f9e-8329-29d6241249c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:38.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:38.908297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:38.909153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:38.909153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:38.909153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:38.909153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 298/612] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:38.914452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c774a9-7928-4a27-b54a-c2a5ad7af677 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:38.960851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d94d1-bbec-431e-83df-29dd0e24ed4d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:38.961150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d94d1-bbec-431e-83df-29dd0e24ed4d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:38.961331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d94d1-bbec-431e-83df-29dd0e24ed4d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:38.962981 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 299/613] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:09:38.967572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:38.972205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14150d3-da7b-488b-bdd6-158fc2a549c3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:38.972492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14150d3-da7b-488b-bdd6-158fc2a549c3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:38.972834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14150d3-da7b-488b-bdd6-158fc2a549c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:38.993796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c14150d3-da7b-488b-bdd6-158fc2a549c3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:38.995162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c14150d3-da7b-488b-bdd6-158fc2a549c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:39.039091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c774a9-7928-4a27-b54a-c2a5ad7af677 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:39.074568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06676b40-76f4-49a1-ae6b-f85069bb7c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:39.075729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06676b40-76f4-49a1-ae6b-f85069bb7c38 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:39.075863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 300/614] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 15:09:39.076077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06676b40-76f4-49a1-ae6b-f85069bb7c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:39.076352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06676b40-76f4-49a1-ae6b-f85069bb7c38 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:39.077069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06676b40-76f4-49a1-ae6b-f85069bb7c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:39.077378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06676b40-76f4-49a1-ae6b-f85069bb7c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:39.079371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06676b40-76f4-49a1-ae6b-f85069bb7c38 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:39.091158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 315/615] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:39.096937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14150d3-da7b-488b-bdd6-158fc2a549c3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:39.150964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:39.198467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14150d3-da7b-488b-bdd6-158fc2a549c3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:39.234172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe195a-7e2f-40a0-b2d6-f0b2d96ded67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:39.234733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe195a-7e2f-40a0-b2d6-f0b2d96ded67 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:39.235011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe195a-7e2f-40a0-b2d6-f0b2d96ded67 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:39.235331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe195a-7e2f-40a0-b2d6-f0b2d96ded67 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:39.242874 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe195a-7e2f-40a0-b2d6-f0b2d96ded67 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:39.244390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe195a-7e2f-40a0-b2d6-f0b2d96ded67 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-07fe195a-7e2f-40a0-b2d6-f0b2d96ded67 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:39.257273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:39.258254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:39.259211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:39.259211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:39.259211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:39.259211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:39.259211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:39.259211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:39.259211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:39.259211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:39.259211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:09:39.259211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:39.259211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 301/616] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:39.266235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06676b40-76f4-49a1-ae6b-f85069bb7c38 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:39.408018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06676b40-76f4-49a1-ae6b-f85069bb7c38 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:39.414833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:39.445782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe195a-7e2f-40a0-b2d6-f0b2d96ded67 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:39.466134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871c82c-835e-4ea9-b655-ed71f09c3655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:39.467093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871c82c-835e-4ea9-b655-ed71f09c3655 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:39.467580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871c82c-835e-4ea9-b655-ed71f09c3655 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:39.468059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871c82c-835e-4ea9-b655-ed71f09c3655 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:39.469079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871c82c-835e-4ea9-b655-ed71f09c3655 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:39.469591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871c82c-835e-4ea9-b655-ed71f09c3655 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:39.471289 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871c82c-835e-4ea9-b655-ed71f09c3655 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:39.494186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 316/617] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 19 15:09:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:39.502941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871c82c-835e-4ea9-b655-ed71f09c3655 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:39.631569 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871c82c-835e-4ea9-b655-ed71f09c3655 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:39.641422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe195a-7e2f-40a0-b2d6-f0b2d96ded67 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:39.666410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:39.670057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff5d78-184d-45ac-8ae6-502f3eb4fdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:39.671233 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff5d78-184d-45ac-8ae6-502f3eb4fdbc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:39.671741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff5d78-184d-45ac-8ae6-502f3eb4fdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:39.672221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff5d78-184d-45ac-8ae6-502f3eb4fdbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:39.690668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff5d78-184d-45ac-8ae6-502f3eb4fdbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:39.692469 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff5d78-184d-45ac-8ae6-502f3eb4fdbc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:39.700447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326bda0-394e-4edb-a02c-b91aacc17692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:39.701135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326bda0-394e-4edb-a02c-b91aacc17692 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:39.701418 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326bda0-394e-4edb-a02c-b91aacc17692 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:39.701689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326bda0-394e-4edb-a02c-b91aacc17692 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:39.712282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326bda0-394e-4edb-a02c-b91aacc17692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f0ff5d78-184d-45ac-8ae6-502f3eb4fdbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:39.712950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:39.713916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:39.715088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:39.715088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:39.715088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:39.717801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 317/618] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3326bda0-394e-4edb-a02c-b91aacc17692 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:39.722244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:39.725226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 302/619] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:39.726132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326bda0-394e-4edb-a02c-b91aacc17692 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:39.734400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff5d78-184d-45ac-8ae6-502f3eb4fdbc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:39.767987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:39.942510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff5d78-184d-45ac-8ae6-502f3eb4fdbc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:39.984961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad048ae-19e1-4fcc-b72b-823c174fc0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:39.985944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad048ae-19e1-4fcc-b72b-823c174fc0de None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:39.986418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad048ae-19e1-4fcc-b72b-823c174fc0de None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:39.986845 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad048ae-19e1-4fcc-b72b-823c174fc0de None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:39.987669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad048ae-19e1-4fcc-b72b-823c174fc0de None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:39.988140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad048ae-19e1-4fcc-b72b-823c174fc0de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:39.989664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad048ae-19e1-4fcc-b72b-823c174fc0de None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:40.008277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 318/620] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:40.011560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326bda0-394e-4edb-a02c-b91aacc17692 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:40.015427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad048ae-19e1-4fcc-b72b-823c174fc0de None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:40.113131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab3cbb-0c86-4a35-acb2-3841811d772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:40.118754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab3cbb-0c86-4a35-acb2-3841811d772b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.119030 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab3cbb-0c86-4a35-acb2-3841811d772b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:40.119299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab3cbb-0c86-4a35-acb2-3841811d772b None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:40.120265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab3cbb-0c86-4a35-acb2-3841811d772b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:40.120265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab3cbb-0c86-4a35-acb2-3841811d772b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:40.122346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab3cbb-0c86-4a35-acb2-3841811d772b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:40.160227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 303/621] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:40.171009 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab3cbb-0c86-4a35-acb2-3841811d772b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:40.231742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:40.257403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:40.265767 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad048ae-19e1-4fcc-b72b-823c174fc0de None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:40.302659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7645345-38cc-449a-93ed-b49058149cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:40.303296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7645345-38cc-449a-93ed-b49058149cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.303579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7645345-38cc-449a-93ed-b49058149cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:40.303912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7645345-38cc-449a-93ed-b49058149cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:40.315563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7645345-38cc-449a-93ed-b49058149cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:40.317159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7645345-38cc-449a-93ed-b49058149cd3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d7645345-38cc-449a-93ed-b49058149cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:40.333460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:40.334653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:40.335512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:40.335512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:40.335512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:40.335512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 319/622] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:40.336125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00376d-39e9-4bdc-9509-a19599c632a6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.336439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00376d-39e9-4bdc-9509-a19599c632a6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:40.336678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00376d-39e9-4bdc-9509-a19599c632a6 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:40.343432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 320/623] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:40.347581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00376d-39e9-4bdc-9509-a19599c632a6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:40.353554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab3cbb-0c86-4a35-acb2-3841811d772b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:40.399195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d2fad-f79f-4010-88ea-8fc8abcf4652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:40.400370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d2fad-f79f-4010-88ea-8fc8abcf4652 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.400825 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d2fad-f79f-4010-88ea-8fc8abcf4652 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:40.401542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d2fad-f79f-4010-88ea-8fc8abcf4652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:40.412357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d2fad-f79f-4010-88ea-8fc8abcf4652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:40.415032 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d2fad-f79f-4010-88ea-8fc8abcf4652 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-633d2fad-f79f-4010-88ea-8fc8abcf4652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:40.433723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:40.434743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:40.435614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:40.435614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:40.435614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:40.435614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:40.435614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:40.435614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:40.435614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:40.435614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:40.437852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 304/624] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:40.439724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49c234-2f7e-4daa-9200-c9173db3d8b3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.440163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49c234-2f7e-4daa-9200-c9173db3d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:40.440560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49c234-2f7e-4daa-9200-c9173db3d8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:40.462411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4f49c234-2f7e-4daa-9200-c9173db3d8b3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:40.463602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4f49c234-2f7e-4daa-9200-c9173db3d8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:40.469806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00376d-39e9-4bdc-9509-a19599c632a6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:40.497806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:40.506590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ff464-6c67-4e93-a495-b59018849f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:40.507191 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ff464-6c67-4e93-a495-b59018849f55 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.507470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ff464-6c67-4e93-a495-b59018849f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:40.507732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ff464-6c67-4e93-a495-b59018849f55 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:40.508362 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ff464-6c67-4e93-a495-b59018849f55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:40.508658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ff464-6c67-4e93-a495-b59018849f55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:40.510156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ff464-6c67-4e93-a495-b59018849f55 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:40.526814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 321/625] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:40.526814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ff464-6c67-4e93-a495-b59018849f55 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:40.542967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 305/626] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:40.544287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1bf42-73df-43e4-87cc-22cff1123215 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.544575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1bf42-73df-43e4-87cc-22cff1123215 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:40.544851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1bf42-73df-43e4-87cc-22cff1123215 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:40.546218 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 306/627] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:40.552129 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1bf42-73df-43e4-87cc-22cff1123215 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:40.577727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:40.666103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1bf42-73df-43e4-87cc-22cff1123215 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:40.674546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ff464-6c67-4e93-a495-b59018849f55 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:40.704944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843174b-4748-496e-8093-dd08c26f0f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:40.705639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843174b-4748-496e-8093-dd08c26f0f61 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.705849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843174b-4748-496e-8093-dd08c26f0f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:40.706165 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843174b-4748-496e-8093-dd08c26f0f61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:40.713717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843174b-4748-496e-8093-dd08c26f0f61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:40.715271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843174b-4748-496e-8093-dd08c26f0f61 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:40.723954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee887c-2ac6-48fd-90c6-6bbba0961699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:40.724832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee887c-2ac6-48fd-90c6-6bbba0961699 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.725317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee887c-2ac6-48fd-90c6-6bbba0961699 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:40.725797 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee887c-2ac6-48fd-90c6-6bbba0961699 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:40.726785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee887c-2ac6-48fd-90c6-6bbba0961699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7843174b-4748-496e-8093-dd08c26f0f61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:40.727083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:40.728064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:40.729045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:40.729045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:40.729045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:40.729045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:40.729045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:40.729045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:40.729045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:40.729045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:40.729045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:09:40.729045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:40.730769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee887c-2ac6-48fd-90c6-6bbba0961699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:40.732440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee887c-2ac6-48fd-90c6-6bbba0961699 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:40.733354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 307/628] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 19 15:09:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:40.734723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa594d-a29a-497e-a49f-1108b0982075 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.734926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa594d-a29a-497e-a49f-1108b0982075 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:40.735200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa594d-a29a-497e-a49f-1108b0982075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:40.754176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 322/629] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:40.755777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee887c-2ac6-48fd-90c6-6bbba0961699 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:40.759100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e0aa594d-a29a-497e-a49f-1108b0982075 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:40.760639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e0aa594d-a29a-497e-a49f-1108b0982075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:40.819243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:40.838057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 308/630] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:40.838057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa594d-a29a-497e-a49f-1108b0982075 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:40.850737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:40.894775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee887c-2ac6-48fd-90c6-6bbba0961699 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:40.942459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9713d8-9c7a-4c47-9fd4-3d06f4394192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:40.943332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9713d8-9c7a-4c47-9fd4-3d06f4394192 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.943684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9713d8-9c7a-4c47-9fd4-3d06f4394192 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:40.944275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9713d8-9c7a-4c47-9fd4-3d06f4394192 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:40.945500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9713d8-9c7a-4c47-9fd4-3d06f4394192 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:40.946021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9713d8-9c7a-4c47-9fd4-3d06f4394192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:40.947909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9713d8-9c7a-4c47-9fd4-3d06f4394192 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:40.951295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa594d-a29a-497e-a49f-1108b0982075 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:40.978202 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 323/631] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 19 15:09:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:40.979055 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9713d8-9c7a-4c47-9fd4-3d06f4394192 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:40.998272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98237408-6c9e-4b5d-9483-137e658a4461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:40.999181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98237408-6c9e-4b5d-9483-137e658a4461 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:40.999795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98237408-6c9e-4b5d-9483-137e658a4461 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:41.000072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98237408-6c9e-4b5d-9483-137e658a4461 None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/62c25756d0814f1dbb8ca210ae34c892/roles/07f9b55cf8dc408984d3e199f474cb91` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:41.018937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98237408-6c9e-4b5d-9483-137e658a4461 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=62c25756d0814f1dbb8ca210ae34c892, role_id=07f9b55cf8dc408984d3e199f474cb91)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:41.020374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98237408-6c9e-4b5d-9483-137e658a4461 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:41.037591 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 309/632] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:09:40 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/62c25756d0814f1dbb8ca210ae34c892/roles/07f9b55cf8dc408984d3e199f474cb91 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:09:41.039008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98237408-6c9e-4b5d-9483-137e658a4461 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:41.090038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9713d8-9c7a-4c47-9fd4-3d06f4394192 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:41.098472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:41.122845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:41.132577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02da14e-c54f-408f-bf4e-12d4d38f4bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:41.133574 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02da14e-c54f-408f-bf4e-12d4d38f4bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:41.134094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02da14e-c54f-408f-bf4e-12d4d38f4bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:41.134605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02da14e-c54f-408f-bf4e-12d4d38f4bc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:41.148370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02da14e-c54f-408f-bf4e-12d4d38f4bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b02da14e-c54f-408f-bf4e-12d4d38f4bc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:41.153992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:41.154949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:41.155783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:41.158639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 324/633] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:41.164917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02da14e-c54f-408f-bf4e-12d4d38f4bc6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:41.169067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98237408-6c9e-4b5d-9483-137e658a4461 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:41.215621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a664aac-4d85-4594-939d-96b01829f0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:41.216552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664aac-4d85-4594-939d-96b01829f0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:41.216833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664aac-4d85-4594-939d-96b01829f0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:41.217107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664aac-4d85-4594-939d-96b01829f0a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:41.289277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02da14e-c54f-408f-bf4e-12d4d38f4bc6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:41.299377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a664aac-4d85-4594-939d-96b01829f0a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:41.300808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a664aac-4d85-4594-939d-96b01829f0a3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:41.324504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33dcd5-3933-4728-91d5-e1934805b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:41.325719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dcd5-3933-4728-91d5-e1934805b718 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:41.325999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dcd5-3933-4728-91d5-e1934805b718 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:41.326360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dcd5-3933-4728-91d5-e1934805b718 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:41.327018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33dcd5-3933-4728-91d5-e1934805b718 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:41.327316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33dcd5-3933-4728-91d5-e1934805b718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:41.328751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33dcd5-3933-4728-91d5-e1934805b718 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:41.341308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 325/634] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:41.341308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33dcd5-3933-4728-91d5-e1934805b718 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:41.366336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:41.373612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:41.408227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 310/635] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:41.409306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92954-4ad4-4300-810a-725237323380 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:41.409588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92954-4ad4-4300-810a-725237323380 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:41.409856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab92954-4ad4-4300-810a-725237323380 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:41.414084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 311/636] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:41.414084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92954-4ad4-4300-810a-725237323380 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:41.457268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33dcd5-3933-4728-91d5-e1934805b718 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:41.497580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0610-e49a-42cd-9037-72fb041a08a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:41.498419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0610-e49a-42cd-9037-72fb041a08a8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:41.498701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0610-e49a-42cd-9037-72fb041a08a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:41.498974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0610-e49a-42cd-9037-72fb041a08a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:41.509855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de0610-e49a-42cd-9037-72fb041a08a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-23de0610-e49a-42cd-9037-72fb041a08a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:41.514948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:41.515874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:41.516702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 326/637] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:41.517370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0610-e49a-42cd-9037-72fb041a08a8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:41.524607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab92954-4ad4-4300-810a-725237323380 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:41.564678 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db7907-31b0-4619-aac0-b42e9b4ce6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:41.565440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db7907-31b0-4619-aac0-b42e9b4ce6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:41.565816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db7907-31b0-4619-aac0-b42e9b4ce6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:41.566209 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db7907-31b0-4619-aac0-b42e9b4ce6f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:41.576478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db7907-31b0-4619-aac0-b42e9b4ce6f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:41.578048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db7907-31b0-4619-aac0-b42e9b4ce6f5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-71db7907-31b0-4619-aac0-b42e9b4ce6f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:41.593147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:41.594322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:41.595437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:41.595437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:41.595437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:41.600498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 312/638] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:41.600498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a965-8782-4b78-be1e-f649b2404a44 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:41.600498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a965-8782-4b78-be1e-f649b2404a44 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:41.600498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a965-8782-4b78-be1e-f649b2404a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:41.615620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7742a965-8782-4b78-be1e-f649b2404a44 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:41.616793 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7742a965-8782-4b78-be1e-f649b2404a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:41.626054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:41.635970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:41.652497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0610-e49a-42cd-9037-72fb041a08a8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:41.684987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 313/639] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:41.689228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410c41e-97d6-423c-98b0-eeb6ddfaa4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:41.689859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410c41e-97d6-423c-98b0-eeb6ddfaa4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:41.690170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410c41e-97d6-423c-98b0-eeb6ddfaa4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:41.690443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410c41e-97d6-423c-98b0-eeb6ddfaa4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:41.691517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742a965-8782-4b78-be1e-f649b2404a44 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:41.701778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410c41e-97d6-423c-98b0-eeb6ddfaa4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:41.703346 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410c41e-97d6-423c-98b0-eeb6ddfaa4e2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9410c41e-97d6-423c-98b0-eeb6ddfaa4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:41.718016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:41.718986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:41.719880 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:41.719880 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:41.719880 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:41.723671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 327/640] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:41.724516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410c41e-97d6-423c-98b0-eeb6ddfaa4e2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:41.832105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742a965-8782-4b78-be1e-f649b2404a44 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:41.834775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410c41e-97d6-423c-98b0-eeb6ddfaa4e2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:41.870021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c6d4e-7f86-4e19-b757-1eb9f2d84c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:41.870897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c6d4e-7f86-4e19-b757-1eb9f2d84c33 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:41.871326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c6d4e-7f86-4e19-b757-1eb9f2d84c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:41.871774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c6d4e-7f86-4e19-b757-1eb9f2d84c33 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:41.872575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c6d4e-7f86-4e19-b757-1eb9f2d84c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:41.873025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c6d4e-7f86-4e19-b757-1eb9f2d84c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:41.874557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041e677-6eae-4a5e-ae2d-a655b0c64459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:41.874766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c6d4e-7f86-4e19-b757-1eb9f2d84c33 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:41.875287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e677-6eae-4a5e-ae2d-a655b0c64459 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:41.875628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e677-6eae-4a5e-ae2d-a655b0c64459 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:41.875963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e677-6eae-4a5e-ae2d-a655b0c64459 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:41.876820 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041e677-6eae-4a5e-ae2d-a655b0c64459 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:41.877209 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041e677-6eae-4a5e-ae2d-a655b0c64459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:41.879046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041e677-6eae-4a5e-ae2d-a655b0c64459 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:41.884686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:41.893572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 314/641] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:41.893572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041e677-6eae-4a5e-ae2d-a655b0c64459 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:41.894207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 328/642] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:41.895669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c6d4e-7f86-4e19-b757-1eb9f2d84c33 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:41.900556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:41.999909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041e677-6eae-4a5e-ae2d-a655b0c64459 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.008740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c6d4e-7f86-4e19-b757-1eb9f2d84c33 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.036453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e26f50-de8a-4c3b-a9e6-93c1e9998c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.037261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e26f50-de8a-4c3b-a9e6-93c1e9998c33 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.037697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e26f50-de8a-4c3b-a9e6-93c1e9998c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.037974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e26f50-de8a-4c3b-a9e6-93c1e9998c33 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.038647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e26f50-de8a-4c3b-a9e6-93c1e9998c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:42.038952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e26f50-de8a-4c3b-a9e6-93c1e9998c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:42.040311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e26f50-de8a-4c3b-a9e6-93c1e9998c33 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:42.045355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3680e4-63c9-482c-8ee1-f59ba408bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.045989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3680e4-63c9-482c-8ee1-f59ba408bbbc None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.046301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3680e4-63c9-482c-8ee1-f59ba408bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.046582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3680e4-63c9-482c-8ee1-f59ba408bbbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.054342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 315/643] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:42.055946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e26f50-de8a-4c3b-a9e6-93c1e9998c33 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:42.056992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3680e4-63c9-482c-8ee1-f59ba408bbbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:42.058485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3680e4-63c9-482c-8ee1-f59ba408bbbc None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-de3680e4-63c9-482c-8ee1-f59ba408bbbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:42.073889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:42.075641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:42.077076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:42.077076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:42.077076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:42.077076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 329/644] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:42.077076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3680e4-63c9-482c-8ee1-f59ba408bbbc None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:42.129261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:42.138170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:42.166445 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e26f50-de8a-4c3b-a9e6-93c1e9998c33 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.193180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3680e4-63c9-482c-8ee1-f59ba408bbbc None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.204931 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049573a-dd3c-4673-b0b0-5026fa0b07c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.205570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049573a-dd3c-4673-b0b0-5026fa0b07c5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.205847 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049573a-dd3c-4673-b0b0-5026fa0b07c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.206149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049573a-dd3c-4673-b0b0-5026fa0b07c5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.214533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049573a-dd3c-4673-b0b0-5026fa0b07c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:42.216043 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049573a-dd3c-4673-b0b0-5026fa0b07c5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b049573a-dd3c-4673-b0b0-5026fa0b07c5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:42.228125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:42.229604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:42.231187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:42.231187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:42.231187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:42.231187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:42.231187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:42.231187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:42.231187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:42.231187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:42.231187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 15:09:42.231187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:42.234428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 316/645] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:42.235103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049573a-dd3c-4673-b0b0-5026fa0b07c5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:42.236068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb2c06-780f-49f7-982d-c1b87589d3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.236767 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb2c06-780f-49f7-982d-c1b87589d3dd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.237112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb2c06-780f-49f7-982d-c1b87589d3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.237714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb2c06-780f-49f7-982d-c1b87589d3dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.250851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb2c06-780f-49f7-982d-c1b87589d3dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2dcb2c06-780f-49f7-982d-c1b87589d3dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:42.255886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:42.256827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 330/646] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:42.258882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb2c06-780f-49f7-982d-c1b87589d3dd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:42.344530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049573a-dd3c-4673-b0b0-5026fa0b07c5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.367069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb2c06-780f-49f7-982d-c1b87589d3dd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.372274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:42.381585 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da199e-a848-4eb7-8e4e-cd42fa8b6512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.382188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da199e-a848-4eb7-8e4e-cd42fa8b6512 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.382482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da199e-a848-4eb7-8e4e-cd42fa8b6512 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.382747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da199e-a848-4eb7-8e4e-cd42fa8b6512 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.383915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:42.390381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da199e-a848-4eb7-8e4e-cd42fa8b6512 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:42.391822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da199e-a848-4eb7-8e4e-cd42fa8b6512 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-56da199e-a848-4eb7-8e4e-cd42fa8b6512 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:42.402857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:42.403729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:42.404604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:42.404604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:42.404604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:42.404604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:42.404604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:42.404604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:42.404604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:42.404604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:42.404604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 317/647] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:42.405102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da199e-a848-4eb7-8e4e-cd42fa8b6512 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:42.410158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57324d5d-038b-473b-a4fe-de639e4771bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.410769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57324d5d-038b-473b-a4fe-de639e4771bd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.411052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57324d5d-038b-473b-a4fe-de639e4771bd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.411328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57324d5d-038b-473b-a4fe-de639e4771bd None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.411976 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57324d5d-038b-473b-a4fe-de639e4771bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:42.412281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57324d5d-038b-473b-a4fe-de639e4771bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:42.413659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57324d5d-038b-473b-a4fe-de639e4771bd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:42.430161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 331/648] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:42.430161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57324d5d-038b-473b-a4fe-de639e4771bd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:42.517688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da199e-a848-4eb7-8e4e-cd42fa8b6512 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.538791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57324d5d-038b-473b-a4fe-de639e4771bd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.553461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7acd7-d861-4194-89db-8ab04c64b166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.554359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7acd7-d861-4194-89db-8ab04c64b166 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.554655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7acd7-d861-4194-89db-8ab04c64b166 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.554928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7acd7-d861-4194-89db-8ab04c64b166 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.555805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7acd7-d861-4194-89db-8ab04c64b166 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:42.556121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7acd7-d861-4194-89db-8ab04c64b166 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:42.558136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7acd7-d861-4194-89db-8ab04c64b166 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:42.576659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 318/649] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 19 15:09:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:42.577540 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7acd7-d861-4194-89db-8ab04c64b166 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:42.582838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04843e-1471-427e-b5c5-6ce23f97e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.583568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04843e-1471-427e-b5c5-6ce23f97e83f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.583954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04843e-1471-427e-b5c5-6ce23f97e83f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.584309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04843e-1471-427e-b5c5-6ce23f97e83f None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.585059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04843e-1471-427e-b5c5-6ce23f97e83f None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:42.585437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04843e-1471-427e-b5c5-6ce23f97e83f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:42.587339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04843e-1471-427e-b5c5-6ce23f97e83f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:42.600679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 332/650] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:42.600679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04843e-1471-427e-b5c5-6ce23f97e83f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:42.631309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:42.635892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:42.687679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7acd7-d861-4194-89db-8ab04c64b166 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.720937 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04843e-1471-427e-b5c5-6ce23f97e83f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.723239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffa6aa-3023-4471-be46-700e88eb1e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.724066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffa6aa-3023-4471-be46-700e88eb1e6f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.724348 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffa6aa-3023-4471-be46-700e88eb1e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.724616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffa6aa-3023-4471-be46-700e88eb1e6f None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.725315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffa6aa-3023-4471-be46-700e88eb1e6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:42.725619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffa6aa-3023-4471-be46-700e88eb1e6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:42.727097 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffa6aa-3023-4471-be46-700e88eb1e6f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:42.744990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 319/651] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:42.744990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffa6aa-3023-4471-be46-700e88eb1e6f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:42.767380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c290e56-d54b-4a59-bfa6-6f6d0e3dc975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.768116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290e56-d54b-4a59-bfa6-6f6d0e3dc975 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.768399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290e56-d54b-4a59-bfa6-6f6d0e3dc975 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.768671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c290e56-d54b-4a59-bfa6-6f6d0e3dc975 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.776198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c290e56-d54b-4a59-bfa6-6f6d0e3dc975 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:42.777677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c290e56-d54b-4a59-bfa6-6f6d0e3dc975 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5c290e56-d54b-4a59-bfa6-6f6d0e3dc975 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:42.788738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:42.789652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 333/652] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:42.791293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c290e56-d54b-4a59-bfa6-6f6d0e3dc975 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:42.855726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffa6aa-3023-4471-be46-700e88eb1e6f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.860130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:42.893148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:42.894657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac12182-493d-4f12-aac7-3e8feecc5dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.895310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12182-493d-4f12-aac7-3e8feecc5dfe None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.895808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12182-493d-4f12-aac7-3e8feecc5dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.895919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12182-493d-4f12-aac7-3e8feecc5dfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.901911 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c290e56-d54b-4a59-bfa6-6f6d0e3dc975 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:42.942373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076714e-0c9d-4d57-be9f-49cc9015d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:42.943009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076714e-0c9d-4d57-be9f-49cc9015d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:42.943290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076714e-0c9d-4d57-be9f-49cc9015d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:42.943565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076714e-0c9d-4d57-be9f-49cc9015d9b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:42.954709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076714e-0c9d-4d57-be9f-49cc9015d9b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:42.956171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076714e-0c9d-4d57-be9f-49cc9015d9b0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:42.968339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac12182-493d-4f12-aac7-3e8feecc5dfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:42.969769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac12182-493d-4f12-aac7-3e8feecc5dfe None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6076714e-0c9d-4d57-be9f-49cc9015d9b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:42.970959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:42.971858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:42.972740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:42.972740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:42.972740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:42.972740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 334/653] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:42.972957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076714e-0c9d-4d57-be9f-49cc9015d9b0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:43.074531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 320/654] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:43.075679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac12182-493d-4f12-aac7-3e8feecc5dfe None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:43.078727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:43.082714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076714e-0c9d-4d57-be9f-49cc9015d9b0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:43.116522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180bb6a-b372-4dd7-ae07-4394b0564bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:43.117112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180bb6a-b372-4dd7-ae07-4394b0564bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:43.117388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180bb6a-b372-4dd7-ae07-4394b0564bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:43.117658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180bb6a-b372-4dd7-ae07-4394b0564bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:43.118430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180bb6a-b372-4dd7-ae07-4394b0564bc1 None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=a86ca59cbf894c508b3439b08715da86) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:43.118735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180bb6a-b372-4dd7-ae07-4394b0564bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:43.120147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180bb6a-b372-4dd7-ae07-4394b0564bc1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:43.125610 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 335/655] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:42 2022] GET /identity/v3/role_assignments?user.id=a86ca59cbf894c508b3439b08715da86&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:43.126461 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180bb6a-b372-4dd7-ae07-4394b0564bc1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:43.143517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:43.187149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac12182-493d-4f12-aac7-3e8feecc5dfe None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:43.225702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca76507-9adf-412e-83fa-7f22dcad9024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:43.226377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca76507-9adf-412e-83fa-7f22dcad9024 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:43.226657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca76507-9adf-412e-83fa-7f22dcad9024 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:43.226937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca76507-9adf-412e-83fa-7f22dcad9024 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:43.227670 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca76507-9adf-412e-83fa-7f22dcad9024 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:43.227993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca76507-9adf-412e-83fa-7f22dcad9024 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:43.229924 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca76507-9adf-412e-83fa-7f22dcad9024 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:43.246816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180bb6a-b372-4dd7-ae07-4394b0564bc1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:43.253258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 321/656] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Aug 19 15:09:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:43.253258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e682-01c6-47f8-847a-6de56db09fbb None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:43.253258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e682-01c6-47f8-847a-6de56db09fbb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:43.253258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8e682-01c6-47f8-847a-6de56db09fbb None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:43.253258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 322/657] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:43.254305 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8e682-01c6-47f8-847a-6de56db09fbb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:43.289111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c4b48-7698-429b-b112-af684ffa38cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:43.289849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4b48-7698-429b-b112-af684ffa38cb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:43.290270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4b48-7698-429b-b112-af684ffa38cb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:43.290826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c4b48-7698-429b-b112-af684ffa38cb None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:43.291486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c4b48-7698-429b-b112-af684ffa38cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:43.291793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c4b48-7698-429b-b112-af684ffa38cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:43.293163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c4b48-7698-429b-b112-af684ffa38cb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:43.306864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 336/658] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:43.307843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c4b48-7698-429b-b112-af684ffa38cb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:43.327693 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:43.373987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8e682-01c6-47f8-847a-6de56db09fbb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:43.383859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:43.412569 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d8b84-984e-4aa1-b820-cac1b1c5ac09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:43.413228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d8b84-984e-4aa1-b820-cac1b1c5ac09 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:43.413503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d8b84-984e-4aa1-b820-cac1b1c5ac09 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:43.413770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d8b84-984e-4aa1-b820-cac1b1c5ac09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:43.415844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c4b48-7698-429b-b112-af684ffa38cb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:43.424357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d8b84-984e-4aa1-b820-cac1b1c5ac09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:43.425938 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d8b84-984e-4aa1-b820-cac1b1c5ac09 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-7e4d8b84-984e-4aa1-b820-cac1b1c5ac09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:43.441727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:43.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:43.443749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:43.443749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:43.443749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:43.443749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 323/659] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:43.444317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226572b-5e8f-450f-b7d0-2300ff5b4254 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:43.444412 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226572b-5e8f-450f-b7d0-2300ff5b4254 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:43.444662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226572b-5e8f-450f-b7d0-2300ff5b4254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:43.455146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d6995-c182-4165-83a4-321412a5bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:43.455765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6995-c182-4165-83a4-321412a5bfda None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:43.456049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6995-c182-4165-83a4-321412a5bfda None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:43.456323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6995-c182-4165-83a4-321412a5bfda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:43.464713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a226572b-5e8f-450f-b7d0-2300ff5b4254 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:43.466503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a226572b-5e8f-450f-b7d0-2300ff5b4254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:43.530553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d6995-c182-4165-83a4-321412a5bfda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:43.532023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d6995-c182-4165-83a4-321412a5bfda None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:43.546373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 324/660] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:43.547664 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226572b-5e8f-450f-b7d0-2300ff5b4254 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:43.600327 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:43.620128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:43.657154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 337/661] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:43.658403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d6995-c182-4165-83a4-321412a5bfda None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:43.661539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226572b-5e8f-450f-b7d0-2300ff5b4254 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:43.697293 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91ee25-a10b-4eeb-b5ae-f4fad7504d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:43.697478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91ee25-a10b-4eeb-b5ae-f4fad7504d78 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:43.697727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91ee25-a10b-4eeb-b5ae-f4fad7504d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:43.697968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91ee25-a10b-4eeb-b5ae-f4fad7504d78 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:43.706572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91ee25-a10b-4eeb-b5ae-f4fad7504d78 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:43.708211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91ee25-a10b-4eeb-b5ae-f4fad7504d78 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0b91ee25-a10b-4eeb-b5ae-f4fad7504d78 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:43.720517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:43.721495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 325/662] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:43.722476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91ee25-a10b-4eeb-b5ae-f4fad7504d78 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:43.774468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d6995-c182-4165-83a4-321412a5bfda None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:43.814576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc398d18-f87c-4787-b176-4c5254e34a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:43.815188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc398d18-f87c-4787-b176-4c5254e34a6a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:43.815814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc398d18-f87c-4787-b176-4c5254e34a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:43.815814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc398d18-f87c-4787-b176-4c5254e34a6a None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:43.816360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc398d18-f87c-4787-b176-4c5254e34a6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:43.816652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc398d18-f87c-4787-b176-4c5254e34a6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:43.818053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc398d18-f87c-4787-b176-4c5254e34a6a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:43.829053 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91ee25-a10b-4eeb-b5ae-f4fad7504d78 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:43.830277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 338/663] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:43.830887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc398d18-f87c-4787-b176-4c5254e34a6a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:43.836705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:43.862404 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:43.872752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de3a6c-1839-4705-8078-22dac81e8bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:43.873793 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de3a6c-1839-4705-8078-22dac81e8bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:43.874113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de3a6c-1839-4705-8078-22dac81e8bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:43.874389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de3a6c-1839-4705-8078-22dac81e8bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:43.885266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de3a6c-1839-4705-8078-22dac81e8bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:43.886868 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de3a6c-1839-4705-8078-22dac81e8bc8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-a3de3a6c-1839-4705-8078-22dac81e8bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:43.901844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:43.902822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:43.903718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:43.903718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:43.903718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:43.903718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 326/664] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:43.903718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de3a6c-1839-4705-8078-22dac81e8bc8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:43.939431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc398d18-f87c-4787-b176-4c5254e34a6a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:43.972849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fc745-0d46-4e56-ad4b-e9945aea4f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:43.973386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fc745-0d46-4e56-ad4b-e9945aea4f00 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:43.973667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fc745-0d46-4e56-ad4b-e9945aea4f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:43.973935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fc745-0d46-4e56-ad4b-e9945aea4f00 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:43.974684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fc745-0d46-4e56-ad4b-e9945aea4f00 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:43.974990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fc745-0d46-4e56-ad4b-e9945aea4f00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:43.976413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fc745-0d46-4e56-ad4b-e9945aea4f00 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:43.993989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 339/665] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Aug 19 15:09:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:43.994820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fc745-0d46-4e56-ad4b-e9945aea4f00 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:44.012580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de3a6c-1839-4705-8078-22dac81e8bc8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:44.047976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451f04-3586-4a9a-a06a-1dbce2051ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:44.048598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451f04-3586-4a9a-a06a-1dbce2051ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:44.048872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451f04-3586-4a9a-a06a-1dbce2051ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:44.049138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f451f04-3586-4a9a-a06a-1dbce2051ab4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:44.059572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f451f04-3586-4a9a-a06a-1dbce2051ab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0f451f04-3586-4a9a-a06a-1dbce2051ab4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:44.064610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:44.065534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:44.066406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 327/666] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:44.067091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451f04-3586-4a9a-a06a-1dbce2051ab4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:44.091515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:44.097233 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:44.110703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fc745-0d46-4e56-ad4b-e9945aea4f00 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:44.147295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe14c76-da4d-4580-81d8-0f63bd4ac815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:44.147922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe14c76-da4d-4580-81d8-0f63bd4ac815 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:44.148196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe14c76-da4d-4580-81d8-0f63bd4ac815 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:44.148468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe14c76-da4d-4580-81d8-0f63bd4ac815 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:44.156110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe14c76-da4d-4580-81d8-0f63bd4ac815 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:44.157810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe14c76-da4d-4580-81d8-0f63bd4ac815 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-cfe14c76-da4d-4580-81d8-0f63bd4ac815 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:44.169641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:44.170659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:44.171553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:44.171553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:44.171553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:44.171553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:44.171553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:44.171553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:44.171553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:44.171553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:44.171553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 340/667] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:44.171553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe14c76-da4d-4580-81d8-0f63bd4ac815 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:44.180208 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f451f04-3586-4a9a-a06a-1dbce2051ab4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:44.214122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acee7f-9ebb-44f5-b930-87aa86758904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:44.214731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acee7f-9ebb-44f5-b930-87aa86758904 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:44.215011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acee7f-9ebb-44f5-b930-87aa86758904 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:44.215843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acee7f-9ebb-44f5-b930-87aa86758904 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:44.216493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acee7f-9ebb-44f5-b930-87aa86758904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:44.216798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acee7f-9ebb-44f5-b930-87aa86758904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:44.218259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acee7f-9ebb-44f5-b930-87aa86758904 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:44.230616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 328/668] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:44.231684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acee7f-9ebb-44f5-b930-87aa86758904 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:44.282635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe14c76-da4d-4580-81d8-0f63bd4ac815 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:44.315497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:44.321549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405d47f-dec2-46f4-8081-36b15d5c2958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:44.322188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405d47f-dec2-46f4-8081-36b15d5c2958 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:44.322474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405d47f-dec2-46f4-8081-36b15d5c2958 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:44.322754 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405d47f-dec2-46f4-8081-36b15d5c2958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:44.339990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acee7f-9ebb-44f5-b930-87aa86758904 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:44.342346 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:44.376599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d18ac-f072-4943-b60b-97c5cedd7b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:44.377201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d18ac-f072-4943-b60b-97c5cedd7b26 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:44.377476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d18ac-f072-4943-b60b-97c5cedd7b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:44.377742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d18ac-f072-4943-b60b-97c5cedd7b26 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:44.378430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d18ac-f072-4943-b60b-97c5cedd7b26 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:44.378733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d18ac-f072-4943-b60b-97c5cedd7b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:44.380163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d18ac-f072-4943-b60b-97c5cedd7b26 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:44.387912 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 329/669] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:44.388776 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d18ac-f072-4943-b60b-97c5cedd7b26 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:44.401584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405d47f-dec2-46f4-8081-36b15d5c2958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:44.403603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405d47f-dec2-46f4-8081-36b15d5c2958 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:44.493852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d18ac-f072-4943-b60b-97c5cedd7b26 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:44.508935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 341/670] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:44.508935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405d47f-dec2-46f4-8081-36b15d5c2958 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:44.538830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb333a-2e5d-46cc-9226-50caf2c6d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:44.539436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb333a-2e5d-46cc-9226-50caf2c6d664 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:44.539714 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb333a-2e5d-46cc-9226-50caf2c6d664 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:44.539984 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb333a-2e5d-46cc-9226-50caf2c6d664 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:44.540683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb333a-2e5d-46cc-9226-50caf2c6d664 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:44.540987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb333a-2e5d-46cc-9226-50caf2c6d664 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:44.542432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb333a-2e5d-46cc-9226-50caf2c6d664 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:44.550637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:44.558492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 330/671] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:44.559429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb333a-2e5d-46cc-9226-50caf2c6d664 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:44.567330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:44.618138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405d47f-dec2-46f4-8081-36b15d5c2958 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:44.651851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e648833-7c4c-4dba-ba64-4a49c000608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:44.652477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e648833-7c4c-4dba-ba64-4a49c000608d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:44.653278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e648833-7c4c-4dba-ba64-4a49c000608d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:44.653551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e648833-7c4c-4dba-ba64-4a49c000608d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:44.660062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e648833-7c4c-4dba-ba64-4a49c000608d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:44.661489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e648833-7c4c-4dba-ba64-4a49c000608d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:44.666018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb333a-2e5d-46cc-9226-50caf2c6d664 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-7e648833-7c4c-4dba-ba64-4a49c000608d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:44.672887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:44.673832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:44.675799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:44.675799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:44.675799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:44.675799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:44.675799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:44.675799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:44.675799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:44.675799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:44.675799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 342/672] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:44.675799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e648833-7c4c-4dba-ba64-4a49c000608d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:44.708892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bba28-a175-4dba-9e35-fe924de7a7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:44.709571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bba28-a175-4dba-9e35-fe924de7a7eb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:44.709934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bba28-a175-4dba-9e35-fe924de7a7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:44.710177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bba28-a175-4dba-9e35-fe924de7a7eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:44.722174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bba28-a175-4dba-9e35-fe924de7a7eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:44.723838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065bba28-a175-4dba-9e35-fe924de7a7eb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-065bba28-a175-4dba-9e35-fe924de7a7eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:44.741634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:44.747733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:44.748849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:44.748849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:44.748849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:44.748849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 331/673] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:44.748849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bba28-a175-4dba-9e35-fe924de7a7eb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:44.791671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e648833-7c4c-4dba-ba64-4a49c000608d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:44.798473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:44.804443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:44.829108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b5181-4a82-49eb-9fb3-cd22415bc102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:44.829739 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b5181-4a82-49eb-9fb3-cd22415bc102 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:44.830020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b5181-4a82-49eb-9fb3-cd22415bc102 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:44.830316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b5181-4a82-49eb-9fb3-cd22415bc102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:44.841046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b5181-4a82-49eb-9fb3-cd22415bc102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:44.842512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b5181-4a82-49eb-9fb3-cd22415bc102 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:44.855982 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bba28-a175-4dba-9e35-fe924de7a7eb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-f08b5181-4a82-49eb-9fb3-cd22415bc102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:44.856740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:44.857646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:44.859003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:44.859003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:44.859003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:44.859003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 343/674] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:44.859003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b5181-4a82-49eb-9fb3-cd22415bc102 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:44.896192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61d0f2-b31f-4d69-a7f4-0ef6f4723237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:44.896800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d0f2-b31f-4d69-a7f4-0ef6f4723237 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:44.897080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d0f2-b31f-4d69-a7f4-0ef6f4723237 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:44.897357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d0f2-b31f-4d69-a7f4-0ef6f4723237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:44.898113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61d0f2-b31f-4d69-a7f4-0ef6f4723237 None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=c23bb3a6586247e0a11ece33569d6d69) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:44.898427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61d0f2-b31f-4d69-a7f4-0ef6f4723237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:44.899858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61d0f2-b31f-4d69-a7f4-0ef6f4723237 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:44.906200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 332/675] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:44 2022] GET /identity/v3/role_assignments?user.id=c23bb3a6586247e0a11ece33569d6d69&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:44.919161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61d0f2-b31f-4d69-a7f4-0ef6f4723237 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:44.974946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b5181-4a82-49eb-9fb3-cd22415bc102 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:45.028039 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b38868-4482-42d7-9cd9-a133a52e6dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:45.029045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b38868-4482-42d7-9cd9-a133a52e6dbe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:45.029832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b38868-4482-42d7-9cd9-a133a52e6dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:45.030369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b38868-4482-42d7-9cd9-a133a52e6dbe None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:45.032139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b38868-4482-42d7-9cd9-a133a52e6dbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:45.032680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b38868-4482-42d7-9cd9-a133a52e6dbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:45.035220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b38868-4482-42d7-9cd9-a133a52e6dbe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:45.051278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 344/676] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:45.052138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b38868-4482-42d7-9cd9-a133a52e6dbe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:45.056577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61d0f2-b31f-4d69-a7f4-0ef6f4723237 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:45.075176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:45.081937 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:45.100968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f14a3-5166-40d4-830a-f1590aa68514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:45.101580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f14a3-5166-40d4-830a-f1590aa68514 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:45.101868 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f14a3-5166-40d4-830a-f1590aa68514 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:45.102176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f14a3-5166-40d4-830a-f1590aa68514 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:45.102835 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f14a3-5166-40d4-830a-f1590aa68514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:45.103143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f14a3-5166-40d4-830a-f1590aa68514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:45.104768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f14a3-5166-40d4-830a-f1590aa68514 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:45.121557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 333/677] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:45.122294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f14a3-5166-40d4-830a-f1590aa68514 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:45.178289 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b38868-4482-42d7-9cd9-a133a52e6dbe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:45.212737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109fa61-4541-406c-bcfd-2d41fcee558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:45.213349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109fa61-4541-406c-bcfd-2d41fcee558f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:45.213634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109fa61-4541-406c-bcfd-2d41fcee558f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:45.213914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109fa61-4541-406c-bcfd-2d41fcee558f None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:45.214585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109fa61-4541-406c-bcfd-2d41fcee558f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:45.214895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109fa61-4541-406c-bcfd-2d41fcee558f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:45.216801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109fa61-4541-406c-bcfd-2d41fcee558f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:45.227889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 345/678] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:45.229082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670f98f-50c6-46d6-8d0d-9629ba7cd36c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:45.229631 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670f98f-50c6-46d6-8d0d-9629ba7cd36c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:45.229909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670f98f-50c6-46d6-8d0d-9629ba7cd36c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:45.231893 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 346/679] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:45.234953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670f98f-50c6-46d6-8d0d-9629ba7cd36c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:45.239239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f14a3-5166-40d4-830a-f1590aa68514 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:45.275387 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1766c-ea49-409c-a7c9-63f3e0e6f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:45.275988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1766c-ea49-409c-a7c9-63f3e0e6f300 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:45.276267 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1766c-ea49-409c-a7c9-63f3e0e6f300 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:45.276543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1766c-ea49-409c-a7c9-63f3e0e6f300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:45.277266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1766c-ea49-409c-a7c9-63f3e0e6f300 None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=895028dd70a0415595a0ff8ebedb1f0f) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:45.278184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1766c-ea49-409c-a7c9-63f3e0e6f300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:45.279829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1766c-ea49-409c-a7c9-63f3e0e6f300 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:45.290068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 334/680] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:45 2022] GET /identity/v3/role_assignments?user.id=895028dd70a0415595a0ff8ebedb1f0f&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:45.290068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1766c-ea49-409c-a7c9-63f3e0e6f300 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:45.344105 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:45.351664 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:45.371796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670f98f-50c6-46d6-8d0d-9629ba7cd36c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:45.409860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5994a-92fe-4879-b313-642fa22ee938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:45.410697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5994a-92fe-4879-b313-642fa22ee938 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:45.411084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5994a-92fe-4879-b313-642fa22ee938 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:45.411458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5994a-92fe-4879-b313-642fa22ee938 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:45.420227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5994a-92fe-4879-b313-642fa22ee938 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:45.421909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5994a-92fe-4879-b313-642fa22ee938 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-61f5994a-92fe-4879-b313-642fa22ee938 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:45.435068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:45.436104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:45.437040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:45.437040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:45.437040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:45.437040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:45.437040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:45.437040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:45.437040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:45.437040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:45.437040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:09:45.437040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:45.437593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1766c-ea49-409c-a7c9-63f3e0e6f300 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:45.437667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 347/681] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:45.439089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bb457-3183-4647-aac3-af1e97be0cce None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:45.439089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bb457-3183-4647-aac3-af1e97be0cce None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:45.439089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bb457-3183-4647-aac3-af1e97be0cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:45.458140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-599bb457-3183-4647-aac3-af1e97be0cce None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:45.459789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-599bb457-3183-4647-aac3-af1e97be0cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:45.492068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b4b89-3dac-43c6-81a6-12a7af8b2c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:45.493814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b4b89-3dac-43c6-81a6-12a7af8b2c74 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:45.494395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b4b89-3dac-43c6-81a6-12a7af8b2c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:45.495070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b4b89-3dac-43c6-81a6-12a7af8b2c74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:45.503898 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b4b89-3dac-43c6-81a6-12a7af8b2c74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:45.505365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b4b89-3dac-43c6-81a6-12a7af8b2c74 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e39b4b89-3dac-43c6-81a6-12a7af8b2c74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:45.522268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:45.523248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:45.524144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:45.524144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:45.524144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:45.524144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:45.524144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:45.524144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:45.524144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:45.524144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:45.524144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 335/682] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:45.524629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b4b89-3dac-43c6-81a6-12a7af8b2c74 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:45.572438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 348/683] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:45.575992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bb457-3183-4647-aac3-af1e97be0cce None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:45.685340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:45.691738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b4b89-3dac-43c6-81a6-12a7af8b2c74 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:45.700152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:45.738781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bb457-3183-4647-aac3-af1e97be0cce None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:45.782528 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d335808-a961-4b00-83b4-10fe68176858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:45.783505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d335808-a961-4b00-83b4-10fe68176858 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:45.784457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d335808-a961-4b00-83b4-10fe68176858 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:45.785370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d335808-a961-4b00-83b4-10fe68176858 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:45.787002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d335808-a961-4b00-83b4-10fe68176858 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:45.787786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d335808-a961-4b00-83b4-10fe68176858 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:45.788605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5b7c-77aa-4788-8a47-1b48e101cc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:45.790248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5b7c-77aa-4788-8a47-1b48e101cc1b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:45.790731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5b7c-77aa-4788-8a47-1b48e101cc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:45.791710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d335808-a961-4b00-83b4-10fe68176858 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:45.792521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5b7c-77aa-4788-8a47-1b48e101cc1b None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:45.793494 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd5b7c-77aa-4788-8a47-1b48e101cc1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:45.795487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd5b7c-77aa-4788-8a47-1b48e101cc1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:45.797160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd5b7c-77aa-4788-8a47-1b48e101cc1b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:45.811532 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 349/684] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:45.817453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d335808-a961-4b00-83b4-10fe68176858 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:45.835073 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 336/685] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 19 15:09:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:45.840722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5b7c-77aa-4788-8a47-1b48e101cc1b None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:45.943725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d335808-a961-4b00-83b4-10fe68176858 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:45.966124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5b7c-77aa-4788-8a47-1b48e101cc1b None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:45.974740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:45.982148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef405ebe-2265-4d04-9800-4d305929180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:45.983080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef405ebe-2265-4d04-9800-4d305929180b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:45.983500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef405ebe-2265-4d04-9800-4d305929180b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:45.983934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef405ebe-2265-4d04-9800-4d305929180b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:45.984892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef405ebe-2265-4d04-9800-4d305929180b None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=a220cf4fafe84d6498bc959a9cd18df7) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:45.985387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef405ebe-2265-4d04-9800-4d305929180b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:45.986975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef405ebe-2265-4d04-9800-4d305929180b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:45.993936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 350/686] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:45 2022] GET /identity/v3/role_assignments?user.id=a220cf4fafe84d6498bc959a9cd18df7&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:45.995235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef405ebe-2265-4d04-9800-4d305929180b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:46.003022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad34cc-9212-4aed-8b2a-7c941d85155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:46.003656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad34cc-9212-4aed-8b2a-7c941d85155c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:46.003940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad34cc-9212-4aed-8b2a-7c941d85155c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:46.004212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad34cc-9212-4aed-8b2a-7c941d85155c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:46.034707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:46.082217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad34cc-9212-4aed-8b2a-7c941d85155c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:46.083592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad34cc-9212-4aed-8b2a-7c941d85155c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:46.115128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef405ebe-2265-4d04-9800-4d305929180b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:46.156870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75042b0f-b3db-41d3-bf26-cae565e85c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:46.157882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75042b0f-b3db-41d3-bf26-cae565e85c7a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:46.158411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75042b0f-b3db-41d3-bf26-cae565e85c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:46.158879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75042b0f-b3db-41d3-bf26-cae565e85c7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:46.171124 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75042b0f-b3db-41d3-bf26-cae565e85c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-75042b0f-b3db-41d3-bf26-cae565e85c7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:46.177091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:46.177993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:46.178853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:46.181573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 351/687] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:46.191267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75042b0f-b3db-41d3-bf26-cae565e85c7a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:46.193210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 337/688] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 15:09:46.203131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad34cc-9212-4aed-8b2a-7c941d85155c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:46.254235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:46.262823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:46.305131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75042b0f-b3db-41d3-bf26-cae565e85c7a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:46.308567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad34cc-9212-4aed-8b2a-7c941d85155c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:46.342493 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b2bd6-6d53-4d0f-aa33-a8c3bddebe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:46.343408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b2bd6-6d53-4d0f-aa33-a8c3bddebe7d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:46.343905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b2bd6-6d53-4d0f-aa33-a8c3bddebe7d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:46.344521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b2bd6-6d53-4d0f-aa33-a8c3bddebe7d None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:46.345358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b2bd6-6d53-4d0f-aa33-a8c3bddebe7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:46.345722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fd8dc-6fb5-483b-bc46-1080bcb615d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:46.346076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b2bd6-6d53-4d0f-aa33-a8c3bddebe7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:46.346539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fd8dc-6fb5-483b-bc46-1080bcb615d9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:46.346899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fd8dc-6fb5-483b-bc46-1080bcb615d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:46.347246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fd8dc-6fb5-483b-bc46-1080bcb615d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:46.348205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b2bd6-6d53-4d0f-aa33-a8c3bddebe7d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:46.358608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fd8dc-6fb5-483b-bc46-1080bcb615d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:46.359275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 352/689] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:46.360328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fd8dc-6fb5-483b-bc46-1080bcb615d9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:46.366067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b2bd6-6d53-4d0f-aa33-a8c3bddebe7d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-728fd8dc-6fb5-483b-bc46-1080bcb615d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:46.376257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:46.377225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:46.378390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:46.378390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:46.378390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:46.378390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 338/690] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:46.383878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fd8dc-6fb5-483b-bc46-1080bcb615d9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:46.492756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fd8dc-6fb5-483b-bc46-1080bcb615d9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:46.505643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b2bd6-6d53-4d0f-aa33-a8c3bddebe7d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:46.506368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:46.528972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:46.544440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b29bb4-ad0b-420c-a56e-d801e71843a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:46.545790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b29bb4-ad0b-420c-a56e-d801e71843a6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:46.546443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b29bb4-ad0b-420c-a56e-d801e71843a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:46.547005 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b29bb4-ad0b-420c-a56e-d801e71843a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:46.547926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b29bb4-ad0b-420c-a56e-d801e71843a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:46.548415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b29bb4-ad0b-420c-a56e-d801e71843a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:46.550572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b29bb4-ad0b-420c-a56e-d801e71843a6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:46.553783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72ff87-f6a9-4de4-889a-2db3d354d5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:46.555023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72ff87-f6a9-4de4-889a-2db3d354d5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:46.555023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72ff87-f6a9-4de4-889a-2db3d354d5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:46.555023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72ff87-f6a9-4de4-889a-2db3d354d5d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:46.567365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72ff87-f6a9-4de4-889a-2db3d354d5d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:46.568791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72ff87-f6a9-4de4-889a-2db3d354d5d7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:46.570071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 339/691] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:46.576121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b29bb4-ad0b-420c-a56e-d801e71843a6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ca72ff87-f6a9-4de4-889a-2db3d354d5d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:46.591390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:46.592402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:46.593325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:46.593325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:46.593325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:46.593325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 353/692] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:46.598591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72ff87-f6a9-4de4-889a-2db3d354d5d7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:46.687567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b29bb4-ad0b-420c-a56e-d801e71843a6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:46.749046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72ff87-f6a9-4de4-889a-2db3d354d5d7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:46.751420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcba651-f179-4934-a765-a11e279c1088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:46.752064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcba651-f179-4934-a765-a11e279c1088 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:46.752342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcba651-f179-4934-a765-a11e279c1088 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:46.752619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcba651-f179-4934-a765-a11e279c1088 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:46.766979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcba651-f179-4934-a765-a11e279c1088 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:46.768446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcba651-f179-4934-a765-a11e279c1088 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2bcba651-f179-4934-a765-a11e279c1088 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:46.791281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:46.792206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:46.793085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:46.793085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:46.793085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:46.793085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:46.793085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:46.793085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:46.793085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:46.793085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:46.800334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 340/693] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:46.801243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcba651-f179-4934-a765-a11e279c1088 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:46.822904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ffb9-52af-4dae-a834-3c5ebb456679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:46.823540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ffb9-52af-4dae-a834-3c5ebb456679 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:46.823786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ffb9-52af-4dae-a834-3c5ebb456679 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:46.824059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56ffb9-52af-4dae-a834-3c5ebb456679 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:46.824743 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56ffb9-52af-4dae-a834-3c5ebb456679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:46.825046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56ffb9-52af-4dae-a834-3c5ebb456679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:46.826437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56ffb9-52af-4dae-a834-3c5ebb456679 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:46.846511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 354/694] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:46.851538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ffb9-52af-4dae-a834-3c5ebb456679 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:46.863248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:46.919406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:46.988315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcba651-f179-4934-a765-a11e279c1088 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:47.014083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56ffb9-52af-4dae-a834-3c5ebb456679 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:47.051963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e0f7f-6a17-49f4-a88d-cfc3a62f2b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:47.052848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e0f7f-6a17-49f4-a88d-cfc3a62f2b18 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:47.053182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e0f7f-6a17-49f4-a88d-cfc3a62f2b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:47.053601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e0f7f-6a17-49f4-a88d-cfc3a62f2b18 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:47.059092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43921456-0a55-4ee7-9743-7c955d6e6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:47.059468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43921456-0a55-4ee7-9743-7c955d6e6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:47.059818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43921456-0a55-4ee7-9743-7c955d6e6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:47.060162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43921456-0a55-4ee7-9743-7c955d6e6ff3 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:47.060929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43921456-0a55-4ee7-9743-7c955d6e6ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:47.061308 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43921456-0a55-4ee7-9743-7c955d6e6ff3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:47.061421 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e0f7f-6a17-49f4-a88d-cfc3a62f2b18 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:47.062892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43921456-0a55-4ee7-9743-7c955d6e6ff3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:47.063015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e0f7f-6a17-49f4-a88d-cfc3a62f2b18 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:47.075996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 341/695] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:47.077424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f2a71-8afe-4cd5-96af-6f26a2de7a41 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9c5e0f7f-6a17-49f4-a88d-cfc3a62f2b18 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:47.077747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:47.078741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:47.079682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:47.079682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:47.079682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:47.079682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:47.079682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:47.079682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:47.079682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:47.079682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:47.079682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:09:47.079682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:47.080628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f2a71-8afe-4cd5-96af-6f26a2de7a41 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:47.080628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f2a71-8afe-4cd5-96af-6f26a2de7a41 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:47.080777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 355/696] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 19 15:09:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:47.083797 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 342/697] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:47.084552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e0f7f-6a17-49f4-a88d-cfc3a62f2b18 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:47.085156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de660f4-78be-4200-9e92-9f196ca64383 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:47.085504 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de660f4-78be-4200-9e92-9f196ca64383 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:47.085851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de660f4-78be-4200-9e92-9f196ca64383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:47.104109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9de660f4-78be-4200-9e92-9f196ca64383 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:47.105620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9de660f4-78be-4200-9e92-9f196ca64383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:47.186061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 343/698] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:47.186061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de660f4-78be-4200-9e92-9f196ca64383 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:47.192140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:47.206256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e0f7f-6a17-49f4-a88d-cfc3a62f2b18 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:47.230825 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:47.249295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ff640-2a6f-4b83-8559-d8bdb9ebf9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:47.249897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ff640-2a6f-4b83-8559-d8bdb9ebf9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:47.250198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ff640-2a6f-4b83-8559-d8bdb9ebf9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:47.250466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ff640-2a6f-4b83-8559-d8bdb9ebf9d0 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:47.251192 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ff640-2a6f-4b83-8559-d8bdb9ebf9d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:47.251490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ff640-2a6f-4b83-8559-d8bdb9ebf9d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:47.252902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90ff640-2a6f-4b83-8559-d8bdb9ebf9d0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:47.292771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 356/699] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 19 15:09:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:47.302451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ff640-2a6f-4b83-8559-d8bdb9ebf9d0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:47.368119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de660f4-78be-4200-9e92-9f196ca64383 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:47.407190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706972c1-9aef-4e6a-b837-61196573d680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:47.408060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706972c1-9aef-4e6a-b837-61196573d680 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:47.408341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706972c1-9aef-4e6a-b837-61196573d680 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:47.408614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706972c1-9aef-4e6a-b837-61196573d680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:47.409344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706972c1-9aef-4e6a-b837-61196573d680 None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=62c25756d0814f1dbb8ca210ae34c892) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:47.409794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706972c1-9aef-4e6a-b837-61196573d680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:47.411250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706972c1-9aef-4e6a-b837-61196573d680 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:47.418326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 344/700] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:47 2022] GET /identity/v3/role_assignments?user.id=62c25756d0814f1dbb8ca210ae34c892&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:47.482252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ff640-2a6f-4b83-8559-d8bdb9ebf9d0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:47.519573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1181ccc-d608-4823-94ac-05234deaadaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:47.520250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1181ccc-d608-4823-94ac-05234deaadaa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:47.520540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1181ccc-d608-4823-94ac-05234deaadaa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:47.520818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1181ccc-d608-4823-94ac-05234deaadaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:47.521513 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706972c1-9aef-4e6a-b837-61196573d680 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:47.537812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:47.635866 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1181ccc-d608-4823-94ac-05234deaadaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:47.637831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1181ccc-d608-4823-94ac-05234deaadaa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:47.667031 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:47.696444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706972c1-9aef-4e6a-b837-61196573d680 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:47.742522 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee71411-5a85-4fcc-bb97-0f06387f39d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:47.743861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71411-5a85-4fcc-bb97-0f06387f39d6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:47.744145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71411-5a85-4fcc-bb97-0f06387f39d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:47.744416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee71411-5a85-4fcc-bb97-0f06387f39d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:47.757372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee71411-5a85-4fcc-bb97-0f06387f39d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:47.759638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee71411-5a85-4fcc-bb97-0f06387f39d6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:47.766550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 357/701] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:47.768028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cab0a-9d0d-404a-9f08-1fd977c9d270 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:47.768158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cab0a-9d0d-404a-9f08-1fd977c9d270 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:47.768449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cab0a-9d0d-404a-9f08-1fd977c9d270 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:47.770931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 358/702] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:47.772895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cab0a-9d0d-404a-9f08-1fd977c9d270 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fee71411-5a85-4fcc-bb97-0f06387f39d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:47.778940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:47.779956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:47.780926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:47.780926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:47.780926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:47.780926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 345/703] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:47.781583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064a35b-b25a-4f95-8c89-3215e834fe9b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:47.781810 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064a35b-b25a-4f95-8c89-3215e834fe9b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:47.782108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064a35b-b25a-4f95-8c89-3215e834fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:47.800780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5064a35b-b25a-4f95-8c89-3215e834fe9b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:47.801967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5064a35b-b25a-4f95-8c89-3215e834fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:47.842389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:47.881258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 346/704] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:47.882193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064a35b-b25a-4f95-8c89-3215e834fe9b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:47.914805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cab0a-9d0d-404a-9f08-1fd977c9d270 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:47.953579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93b9d7-f000-4d56-8b18-ebbe72b660c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:47.953808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:47.954506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93b9d7-f000-4d56-8b18-ebbe72b660c4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:47.954791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93b9d7-f000-4d56-8b18-ebbe72b660c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:47.955550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93b9d7-f000-4d56-8b18-ebbe72b660c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:47.971414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93b9d7-f000-4d56-8b18-ebbe72b660c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:47.974090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93b9d7-f000-4d56-8b18-ebbe72b660c4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-af93b9d7-f000-4d56-8b18-ebbe72b660c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:47.996950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:47.998056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:47.999012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:47.999012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:47.999012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:47.999012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 359/705] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:48.003832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93b9d7-f000-4d56-8b18-ebbe72b660c4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:48.040960 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064a35b-b25a-4f95-8c89-3215e834fe9b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:48.110273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb1f25-376e-48c8-9fe3-5f5d31fbc4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:48.110889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb1f25-376e-48c8-9fe3-5f5d31fbc4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:48.111166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb1f25-376e-48c8-9fe3-5f5d31fbc4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:48.111438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb1f25-376e-48c8-9fe3-5f5d31fbc4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:48.112090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb1f25-376e-48c8-9fe3-5f5d31fbc4b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:48.112390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb1f25-376e-48c8-9fe3-5f5d31fbc4b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:48.113756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb1f25-376e-48c8-9fe3-5f5d31fbc4b6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:48.137749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 347/706] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:48.143425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb1f25-376e-48c8-9fe3-5f5d31fbc4b6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:48.186156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:48.190078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93b9d7-f000-4d56-8b18-ebbe72b660c4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:48.225645 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14b113-d1bd-49b6-977c-eb0a45f500b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:48.226275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14b113-d1bd-49b6-977c-eb0a45f500b6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:48.226551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14b113-d1bd-49b6-977c-eb0a45f500b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:48.226822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14b113-d1bd-49b6-977c-eb0a45f500b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:48.227488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14b113-d1bd-49b6-977c-eb0a45f500b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:48.227763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14b113-d1bd-49b6-977c-eb0a45f500b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:48.229373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14b113-d1bd-49b6-977c-eb0a45f500b6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:48.245582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 360/707] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:48.247037 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14b113-d1bd-49b6-977c-eb0a45f500b6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:48.271050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb1f25-376e-48c8-9fe3-5f5d31fbc4b6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:48.295410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:48.307913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b7fe6-2ebd-4eb3-9228-11411f70ad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:48.308526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b7fe6-2ebd-4eb3-9228-11411f70ad0f None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:48.309371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b7fe6-2ebd-4eb3-9228-11411f70ad0f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:48.309650 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b7fe6-2ebd-4eb3-9228-11411f70ad0f None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:48.310334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b7fe6-2ebd-4eb3-9228-11411f70ad0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:48.311764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b7fe6-2ebd-4eb3-9228-11411f70ad0f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:48.336423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 348/708] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:09:48 2022] POST /identity/v3/users => generated 254 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:09:48.337444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b7fe6-2ebd-4eb3-9228-11411f70ad0f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:48.351118 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14b113-d1bd-49b6-977c-eb0a45f500b6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:48.387697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7934453-0b8d-4fd0-b019-8230490fd0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:48.388351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934453-0b8d-4fd0-b019-8230490fd0bd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:48.388659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934453-0b8d-4fd0-b019-8230490fd0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:48.388894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7934453-0b8d-4fd0-b019-8230490fd0bd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:48.389490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7934453-0b8d-4fd0-b019-8230490fd0bd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:48.390905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7934453-0b8d-4fd0-b019-8230490fd0bd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a7934453-0b8d-4fd0-b019-8230490fd0bd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:48.402419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:48.404940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:48.407083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 361/709] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Aug 19 15:09:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:48.415106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7934453-0b8d-4fd0-b019-8230490fd0bd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:48.459752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b7fe6-2ebd-4eb3-9228-11411f70ad0f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:48.460676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:48.511242 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb350c9-1c93-467c-ac9c-29bd3e9b8946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:48.511980 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb350c9-1c93-467c-ac9c-29bd3e9b8946 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:48.512264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb350c9-1c93-467c-ac9c-29bd3e9b8946 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:48.512538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb350c9-1c93-467c-ac9c-29bd3e9b8946 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:48.520349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb350c9-1c93-467c-ac9c-29bd3e9b8946 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:48.527329 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb350c9-1c93-467c-ac9c-29bd3e9b8946 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-dcb350c9-1c93-467c-ac9c-29bd3e9b8946 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:48.536262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:48.538200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:48.539344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:48.539344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:48.539344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:48.539344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:48.539344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:48.539344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:48.539344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:48.539344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:48.539344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 349/710] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:48.543673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb350c9-1c93-467c-ac9c-29bd3e9b8946 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:48.585922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7934453-0b8d-4fd0-b019-8230490fd0bd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:48.604894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:48.635877 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec69ee-815c-4c06-b45f-4e8653d4d761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:48.636577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec69ee-815c-4c06-b45f-4e8653d4d761 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:48.637204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec69ee-815c-4c06-b45f-4e8653d4d761 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:48.637486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec69ee-815c-4c06-b45f-4e8653d4d761 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:48.638157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec69ee-815c-4c06-b45f-4e8653d4d761 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:48.638682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec69ee-815c-4c06-b45f-4e8653d4d761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:48.640974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec69ee-815c-4c06-b45f-4e8653d4d761 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:48.645850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 362/711] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 19 15:09:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:48.647611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f048d37-a0a1-4ebc-96bd-44e45ee04665 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:48.647909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f048d37-a0a1-4ebc-96bd-44e45ee04665 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:48.648187 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f048d37-a0a1-4ebc-96bd-44e45ee04665 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:48.650506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 363/712] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:48.651228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f048d37-a0a1-4ebc-96bd-44e45ee04665 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:48.678193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb350c9-1c93-467c-ac9c-29bd3e9b8946 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:48.719766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67463a2d-0929-4954-974a-96350faa9d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:48.720671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463a2d-0929-4954-974a-96350faa9d2d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:48.721102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463a2d-0929-4954-974a-96350faa9d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:48.721479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67463a2d-0929-4954-974a-96350faa9d2d None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:48.722211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67463a2d-0929-4954-974a-96350faa9d2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:48.722677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67463a2d-0929-4954-974a-96350faa9d2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:48.724715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67463a2d-0929-4954-974a-96350faa9d2d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:48.742125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 350/713] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:48.743520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8e869-f05a-4849-9614-92c0d4d6c897 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:48.743804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8e869-f05a-4849-9614-92c0d4d6c897 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:48.744079 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8e869-f05a-4849-9614-92c0d4d6c897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:48.761533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:48.767778 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fdf8e869-f05a-4849-9614-92c0d4d6c897 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:48.769288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fdf8e869-f05a-4849-9614-92c0d4d6c897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:48.771473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f048d37-a0a1-4ebc-96bd-44e45ee04665 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:48.807533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f2750-2a87-4c04-a395-4996b1646946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:48.808141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f2750-2a87-4c04-a395-4996b1646946 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:48.808418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f2750-2a87-4c04-a395-4996b1646946 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:48.808688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f2750-2a87-4c04-a395-4996b1646946 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:48.809879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f2750-2a87-4c04-a395-4996b1646946 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:48.810253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f2750-2a87-4c04-a395-4996b1646946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:48.811634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f2750-2a87-4c04-a395-4996b1646946 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:48.817633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 364/714] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 19 15:09:48 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:48.818182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f2750-2a87-4c04-a395-4996b1646946 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:48.857232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 351/715] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:48.940629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f2750-2a87-4c04-a395-4996b1646946 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:48.986220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bc52b-8377-481c-8846-7b6fafcedd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:48.987053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bc52b-8377-481c-8846-7b6fafcedd18 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:48.987501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bc52b-8377-481c-8846-7b6fafcedd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:48.987930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bc52b-8377-481c-8846-7b6fafcedd18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:48.988816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bc52b-8377-481c-8846-7b6fafcedd18 None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=a86ca59cbf894c508b3439b08715da86) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:48.989276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bc52b-8377-481c-8846-7b6fafcedd18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:48.990872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bc52b-8377-481c-8846-7b6fafcedd18 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:49.002158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 365/716] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:48 2022] GET /identity/v3/role_assignments?user.id=a86ca59cbf894c508b3439b08715da86&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:49.189059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8e869-f05a-4849-9614-92c0d4d6c897 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:49.220263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:49.294870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8e869-f05a-4849-9614-92c0d4d6c897 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:49.329534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40385f2f-934d-4d8a-b495-48b2c07ce5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:49.330193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40385f2f-934d-4d8a-b495-48b2c07ce5ce None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:49.330470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40385f2f-934d-4d8a-b495-48b2c07ce5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:49.330737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40385f2f-934d-4d8a-b495-48b2c07ce5ce None admin] PATH_INFO: `/v3/services/network` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:49.331316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40385f2f-934d-4d8a-b495-48b2c07ce5ce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:49.332672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40385f2f-934d-4d8a-b495-48b2c07ce5ce None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-40385f2f-934d-4d8a-b495-48b2c07ce5ce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:49.344060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:49.345121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:49.345998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 352/717] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:49 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:49.353105 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bc52b-8377-481c-8846-7b6fafcedd18 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:49.370393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:49.507613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bc52b-8377-481c-8846-7b6fafcedd18 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:49.567759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a5898-8c80-4062-85df-fe2711ced738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:49.568378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a5898-8c80-4062-85df-fe2711ced738 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:49.568659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a5898-8c80-4062-85df-fe2711ced738 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:49.568940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a5898-8c80-4062-85df-fe2711ced738 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:49.569577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a5898-8c80-4062-85df-fe2711ced738 None admin] RBAC: Adding query filter params (name=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:49.569885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a5898-8c80-4062-85df-fe2711ced738 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:49.571290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a5898-8c80-4062-85df-fe2711ced738 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:49.578104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 366/718] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:09:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:49.583983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40385f2f-934d-4d8a-b495-48b2c07ce5ce None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:49.708353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:49.715032 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40385f2f-934d-4d8a-b495-48b2c07ce5ce None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:49.751286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd587aa-7bd5-4ff5-8adb-0783969c5bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:49.751895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd587aa-7bd5-4ff5-8adb-0783969c5bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:49.752173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd587aa-7bd5-4ff5-8adb-0783969c5bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:49.752442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd587aa-7bd5-4ff5-8adb-0783969c5bd6 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:49.753071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd587aa-7bd5-4ff5-8adb-0783969c5bd6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:49.753368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd587aa-7bd5-4ff5-8adb-0783969c5bd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:49.754752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd587aa-7bd5-4ff5-8adb-0783969c5bd6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:49.760770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 353/719] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:09:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:50.007152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0ae7-e44c-4af1-9be2-8a329dd6c9a9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:50.007658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0ae7-e44c-4af1-9be2-8a329dd6c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:50.007764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c0ae7-e44c-4af1-9be2-8a329dd6c9a9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:50.009273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 367/720] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:50.014434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e254c8-93e5-45c7-ac22-60dd06f0dd70 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:50.014722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e254c8-93e5-45c7-ac22-60dd06f0dd70 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:50.014996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e254c8-93e5-45c7-ac22-60dd06f0dd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:50.036830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-45e254c8-93e5-45c7-ac22-60dd06f0dd70 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:50.038058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-45e254c8-93e5-45c7-ac22-60dd06f0dd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:50.113026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 354/721] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:50.429479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c0ae7-e44c-4af1-9be2-8a329dd6c9a9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:50.532833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:50.557963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c0ae7-e44c-4af1-9be2-8a329dd6c9a9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:50.592423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7a208-8de9-44e4-b5c7-96bd656d5e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:50.593065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7a208-8de9-44e4-b5c7-96bd656d5e30 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:50.593342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7a208-8de9-44e4-b5c7-96bd656d5e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:50.593614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7a208-8de9-44e4-b5c7-96bd656d5e30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:50.603792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7a208-8de9-44e4-b5c7-96bd656d5e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-43a7a208-8de9-44e4-b5c7-96bd656d5e30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:50.609793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:50.610774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:50.611620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 368/722] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:50.616892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e254c8-93e5-45c7-ac22-60dd06f0dd70 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:50.730671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:50.748187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e254c8-93e5-45c7-ac22-60dd06f0dd70 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:50.806682 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6d222-bd40-464a-ad25-dc976f386a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:50.807494 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6d222-bd40-464a-ad25-dc976f386a9e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:50.807937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6d222-bd40-464a-ad25-dc976f386a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:50.808372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6d222-bd40-464a-ad25-dc976f386a9e None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:50.809664 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6d222-bd40-464a-ad25-dc976f386a9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:50.810181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6d222-bd40-464a-ad25-dc976f386a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:50.812015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6d222-bd40-464a-ad25-dc976f386a9e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:50.827474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 355/723] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:50.832876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7a208-8de9-44e4-b5c7-96bd656d5e30 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:50.977700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7a208-8de9-44e4-b5c7-96bd656d5e30 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:51.000438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e4040-e0de-4da7-acf4-4cf032f19c66 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.000885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e4040-e0de-4da7-acf4-4cf032f19c66 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.001317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e4040-e0de-4da7-acf4-4cf032f19c66 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.011125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 356/724] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:50 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:09:51.012654 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd7cbb-e030-4cd8-8efd-bc41ccdd3003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:51.013303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd7cbb-e030-4cd8-8efd-bc41ccdd3003 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.013559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd7cbb-e030-4cd8-8efd-bc41ccdd3003 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.013834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd7cbb-e030-4cd8-8efd-bc41ccdd3003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.017432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecc031-7fcf-47d0-b3e8-d02fb5ec9bb3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.017872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecc031-7fcf-47d0-b3e8-d02fb5ec9bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.018366 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecc031-7fcf-47d0-b3e8-d02fb5ec9bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.034121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:51.038833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-21ecc031-7fcf-47d0-b3e8-d02fb5ec9bb3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:51.040157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd7cbb-e030-4cd8-8efd-bc41ccdd3003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:51.040879 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-21ecc031-7fcf-47d0-b3e8-d02fb5ec9bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:51.042082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fd7cbb-e030-4cd8-8efd-bc41ccdd3003 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-71fd7cbb-e030-4cd8-8efd-bc41ccdd3003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:51.071433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:51.072409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:51.073291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:51.073291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:51.073291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:51.079564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 369/725] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:51.080785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd7cbb-e030-4cd8-8efd-bc41ccdd3003 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:51.129861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 357/726] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:51.210406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd7cbb-e030-4cd8-8efd-bc41ccdd3003 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:51.221459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d08bd1-cc28-4a75-86b2-b625ac9790a4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.222047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d08bd1-cc28-4a75-86b2-b625ac9790a4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.222724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d08bd1-cc28-4a75-86b2-b625ac9790a4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.228153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 358/727] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:51.230382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7bf6b-35b1-4e72-a809-be80f3696d98 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.231464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7bf6b-35b1-4e72-a809-be80f3696d98 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.231983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7bf6b-35b1-4e72-a809-be80f3696d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.253228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85450e19-b8db-4d32-9f4d-9e18d901afb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:51.253778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85450e19-b8db-4d32-9f4d-9e18d901afb6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.254095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85450e19-b8db-4d32-9f4d-9e18d901afb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.254378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85450e19-b8db-4d32-9f4d-9e18d901afb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.255029 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85450e19-b8db-4d32-9f4d-9e18d901afb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:51.255448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85450e19-b8db-4d32-9f4d-9e18d901afb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:51.256836 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85450e19-b8db-4d32-9f4d-9e18d901afb6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:51.264263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-24b7bf6b-35b1-4e72-a809-be80f3696d98 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:51.265453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-24b7bf6b-35b1-4e72-a809-be80f3696d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:51.284384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 370/728] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:51.289350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85450e19-b8db-4d32-9f4d-9e18d901afb6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:51.368718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 359/729] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:51.380561 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:51.421357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d67042-ccf0-44c0-a0df-a86a5620c362 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.421800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d67042-ccf0-44c0-a0df-a86a5620c362 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.422170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d67042-ccf0-44c0-a0df-a86a5620c362 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.423704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 360/730] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:09:51.428721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488859f8-71b8-4f81-b004-7a060e15b65f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.429113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488859f8-71b8-4f81-b004-7a060e15b65f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.429488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488859f8-71b8-4f81-b004-7a060e15b65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.434081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85450e19-b8db-4d32-9f4d-9e18d901afb6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:51.470907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112d8a3-5b68-4240-a008-cee5d94af627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:51.471158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-488859f8-71b8-4f81-b004-7a060e15b65f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:51.471927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112d8a3-5b68-4240-a008-cee5d94af627 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.472294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-488859f8-71b8-4f81-b004-7a060e15b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:51.472712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112d8a3-5b68-4240-a008-cee5d94af627 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.473355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112d8a3-5b68-4240-a008-cee5d94af627 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.486362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:51.487263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112d8a3-5b68-4240-a008-cee5d94af627 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:51.490409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112d8a3-5b68-4240-a008-cee5d94af627 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c112d8a3-5b68-4240-a008-cee5d94af627 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:51.512726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:51.513800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:51.514787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:51.514787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:51.514787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:51.514787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:51.514787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:51.514787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:51.514787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:51.514787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:51.514787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:09:51.514787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:51.515367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 371/731] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:51.516086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112d8a3-5b68-4240-a008-cee5d94af627 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:51.578194 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 361/732] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:51.579514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488859f8-71b8-4f81-b004-7a060e15b65f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:51.655872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112d8a3-5b68-4240-a008-cee5d94af627 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:51.674209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:51.692384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488859f8-71b8-4f81-b004-7a060e15b65f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:51.727787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7695145-df29-498c-b057-6d53aebb6ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:51.728830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695145-df29-498c-b057-6d53aebb6ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.729628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695145-df29-498c-b057-6d53aebb6ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.730159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695145-df29-498c-b057-6d53aebb6ad9 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.731701 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7695145-df29-498c-b057-6d53aebb6ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:51.732206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7695145-df29-498c-b057-6d53aebb6ad9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:51.733822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7695145-df29-498c-b057-6d53aebb6ad9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:51.735907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6be39-3f17-4cf9-be51-d96919db0ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:51.736575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6be39-3f17-4cf9-be51-d96919db0ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.737589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6be39-3f17-4cf9-be51-d96919db0ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.737870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6be39-3f17-4cf9-be51-d96919db0ba6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.750384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:51.751432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6be39-3f17-4cf9-be51-d96919db0ba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:51.758364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 362/733] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 19 15:09:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:51.758364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7695145-df29-498c-b057-6d53aebb6ad9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-60c6be39-3f17-4cf9-be51-d96919db0ba6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:51.762063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:51.763030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:51.763884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:51.767817 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 372/734] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:51.768650 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6be39-3f17-4cf9-be51-d96919db0ba6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:51.866433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7695145-df29-498c-b057-6d53aebb6ad9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:51.871849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6be39-3f17-4cf9-be51-d96919db0ba6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:51.901135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddfd14-5973-40cc-8c3c-1c21991bdcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:51.901739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfd14-5973-40cc-8c3c-1c21991bdcab None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.902021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfd14-5973-40cc-8c3c-1c21991bdcab None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.902323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddfd14-5973-40cc-8c3c-1c21991bdcab None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.903504 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddfd14-5973-40cc-8c3c-1c21991bdcab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:51.904846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddfd14-5973-40cc-8c3c-1c21991bdcab None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:51.908631 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded6e1-726c-41e4-9edd-8680a80aec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:51.909434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded6e1-726c-41e4-9edd-8680a80aec99 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:51.909931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded6e1-726c-41e4-9edd-8680a80aec99 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:51.910389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bded6e1-726c-41e4-9edd-8680a80aec99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:51.926072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 363/735] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:09:51 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:09:51.926072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddfd14-5973-40cc-8c3c-1c21991bdcab None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:51.972545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:52.002478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:52.007230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bded6e1-726c-41e4-9edd-8680a80aec99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:52.009011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bded6e1-726c-41e4-9edd-8680a80aec99 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:52.064751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddfd14-5973-40cc-8c3c-1c21991bdcab None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:52.103632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131f058-8d1f-494d-9a84-46e9fae9de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:52.104697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131f058-8d1f-494d-9a84-46e9fae9de45 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:52.105053 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131f058-8d1f-494d-9a84-46e9fae9de45 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:52.105408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131f058-8d1f-494d-9a84-46e9fae9de45 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:52.106728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131f058-8d1f-494d-9a84-46e9fae9de45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:52.107997 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131f058-8d1f-494d-9a84-46e9fae9de45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:52.108429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131f058-8d1f-494d-9a84-46e9fae9de45 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:52.117779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 364/736] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:52.118861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131f058-8d1f-494d-9a84-46e9fae9de45 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:52.128264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 373/737] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 15:09:52.133525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded6e1-726c-41e4-9edd-8680a80aec99 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:52.238360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131f058-8d1f-494d-9a84-46e9fae9de45 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:52.270835 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:52.281410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a4686-0763-429d-aee9-ee118bc5c10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:52.282890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a4686-0763-429d-aee9-ee118bc5c10d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:52.283336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a4686-0763-429d-aee9-ee118bc5c10d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:52.284010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a4686-0763-429d-aee9-ee118bc5c10d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:52.298264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a4686-0763-429d-aee9-ee118bc5c10d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-090a4686-0763-429d-aee9-ee118bc5c10d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:52.305663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:52.306799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:52.307812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:52.310539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 365/738] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:52.311596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a4686-0763-429d-aee9-ee118bc5c10d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:52.330842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:52.366911 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bded6e1-726c-41e4-9edd-8680a80aec99 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:52.401737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35c73f-317c-4f98-920b-f320457baa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:52.403069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c73f-317c-4f98-920b-f320457baa10 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:52.403422 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c73f-317c-4f98-920b-f320457baa10 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:52.403764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c73f-317c-4f98-920b-f320457baa10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:52.414578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35c73f-317c-4f98-920b-f320457baa10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:52.416111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35c73f-317c-4f98-920b-f320457baa10 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ff35c73f-317c-4f98-920b-f320457baa10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:52.431137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:52.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:52.433015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:52.433015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:52.433015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:52.433015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 374/739] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:52.433015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35c73f-317c-4f98-920b-f320457baa10 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:52.442383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a4686-0763-429d-aee9-ee118bc5c10d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:52.480378 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993a61-3ea6-4831-ba7b-27536162a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:52.481087 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993a61-3ea6-4831-ba7b-27536162a6aa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:52.481372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993a61-3ea6-4831-ba7b-27536162a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:52.481644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993a61-3ea6-4831-ba7b-27536162a6aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:52.493362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98993a61-3ea6-4831-ba7b-27536162a6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:52.495050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98993a61-3ea6-4831-ba7b-27536162a6aa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-98993a61-3ea6-4831-ba7b-27536162a6aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:52.510118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:52.511116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:52.512587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:52.512587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:52.512587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:52.512587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 366/740] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:52.513257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697a60b-f9e0-4459-8ac3-7642f7ffb3bc None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:52.513257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697a60b-f9e0-4459-8ac3-7642f7ffb3bc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:52.513527 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697a60b-f9e0-4459-8ac3-7642f7ffb3bc None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:52.518898 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 367/741] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:52.519667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697a60b-f9e0-4459-8ac3-7642f7ffb3bc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:52.542655 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35c73f-317c-4f98-920b-f320457baa10 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:52.557766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:52.569144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:52.584317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b3c02-dc44-48f3-9e4d-dad91a06e157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:52.584891 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b3c02-dc44-48f3-9e4d-dad91a06e157 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:52.585170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b3c02-dc44-48f3-9e4d-dad91a06e157 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:52.585437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b3c02-dc44-48f3-9e4d-dad91a06e157 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:52.586602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b3c02-dc44-48f3-9e4d-dad91a06e157 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:52.587194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b3c02-dc44-48f3-9e4d-dad91a06e157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:52.588914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b3c02-dc44-48f3-9e4d-dad91a06e157 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:52.598123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 375/742] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:52.603300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b3c02-dc44-48f3-9e4d-dad91a06e157 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:52.637532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697a60b-f9e0-4459-8ac3-7642f7ffb3bc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:52.680430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588d49e-559e-4d75-a484-489b8b3aeb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:52.681039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588d49e-559e-4d75-a484-489b8b3aeb08 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:52.681325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588d49e-559e-4d75-a484-489b8b3aeb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:52.681607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588d49e-559e-4d75-a484-489b8b3aeb08 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:52.682380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588d49e-559e-4d75-a484-489b8b3aeb08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:52.682686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588d49e-559e-4d75-a484-489b8b3aeb08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:52.685115 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588d49e-559e-4d75-a484-489b8b3aeb08 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:52.703321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 368/743] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:52.703321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1316ca-775f-4a16-bf2c-92e7c728c3d6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:52.703321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1316ca-775f-4a16-bf2c-92e7c728c3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:52.703321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1316ca-775f-4a16-bf2c-92e7c728c3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:52.710431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b3c02-dc44-48f3-9e4d-dad91a06e157 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:52.724969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bf1316ca-775f-4a16-bf2c-92e7c728c3d6 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:52.726195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bf1316ca-775f-4a16-bf2c-92e7c728c3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:52.745689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eaa2a-f9b9-4139-bef2-4a29e63431f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:52.746836 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eaa2a-f9b9-4139-bef2-4a29e63431f4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:52.747118 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eaa2a-f9b9-4139-bef2-4a29e63431f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:52.747391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eaa2a-f9b9-4139-bef2-4a29e63431f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:52.748031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eaa2a-f9b9-4139-bef2-4a29e63431f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:52.748336 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eaa2a-f9b9-4139-bef2-4a29e63431f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:52.749705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552eaa2a-f9b9-4139-bef2-4a29e63431f4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:52.761135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 376/744] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:52.762478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eaa2a-f9b9-4139-bef2-4a29e63431f4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:52.811854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:52.873101 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eaa2a-f9b9-4139-bef2-4a29e63431f4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:52.909977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7ac29-8f9a-42b0-90f6-f8042c9be2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:52.910637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7ac29-8f9a-42b0-90f6-f8042c9be2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:52.910917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7ac29-8f9a-42b0-90f6-f8042c9be2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:52.911189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7ac29-8f9a-42b0-90f6-f8042c9be2d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:52.926058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 369/745] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:52 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 15:09:52.926058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1316ca-775f-4a16-bf2c-92e7c728c3d6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:52.926317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7ac29-8f9a-42b0-90f6-f8042c9be2d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:52.926317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7ac29-8f9a-42b0-90f6-f8042c9be2d4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b1c7ac29-8f9a-42b0-90f6-f8042c9be2d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:52.938614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:52.939757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:52.940841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:52.940841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:52.940841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:52.941555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 377/746] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:52.942340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7ac29-8f9a-42b0-90f6-f8042c9be2d4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:52.948946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:53.039844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1316ca-775f-4a16-bf2c-92e7c728c3d6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:53.068141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:53.077125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5009b-2ce5-43b7-9a30-21d73732457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:53.077498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7ac29-8f9a-42b0-90f6-f8042c9be2d4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:53.077779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5009b-2ce5-43b7-9a30-21d73732457a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:53.078090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5009b-2ce5-43b7-9a30-21d73732457a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:53.078366 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5009b-2ce5-43b7-9a30-21d73732457a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:53.088331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5009b-2ce5-43b7-9a30-21d73732457a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:53.090960 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5009b-2ce5-43b7-9a30-21d73732457a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-2ef5009b-2ce5-43b7-9a30-21d73732457a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:53.107654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:53.108581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:53.109514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:53.109514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:53.109514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:53.109514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:53.109514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:53.109514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:53.109514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:53.109514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:53.109514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:09:53.109514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:53.110059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 370/747] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 19 15:09:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:53.110850 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5009b-2ce5-43b7-9a30-21d73732457a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:53.118058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649e89d-c811-41ee-96b0-12caacd76b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:53.118877 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649e89d-c811-41ee-96b0-12caacd76b5c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:53.119250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649e89d-c811-41ee-96b0-12caacd76b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:53.119616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649e89d-c811-41ee-96b0-12caacd76b5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:53.129317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649e89d-c811-41ee-96b0-12caacd76b5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:53.131180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649e89d-c811-41ee-96b0-12caacd76b5c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d649e89d-c811-41ee-96b0-12caacd76b5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:53.145350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:53.147382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:53.149603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:53.149603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:53.149603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:53.149603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:53.149603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:53.149603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:53.149603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:53.149603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:53.149603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 378/748] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:53.149603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649e89d-c811-41ee-96b0-12caacd76b5c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:53.204219 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:53.229528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5009b-2ce5-43b7-9a30-21d73732457a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:53.271029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf8333-9057-457e-9393-35d704a42d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:53.271641 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf8333-9057-457e-9393-35d704a42d90 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:53.271925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf8333-9057-457e-9393-35d704a42d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:53.272048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649e89d-c811-41ee-96b0-12caacd76b5c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:53.272206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf8333-9057-457e-9393-35d704a42d90 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:53.272832 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf8333-9057-457e-9393-35d704a42d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:53.273140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf8333-9057-457e-9393-35d704a42d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:53.275435 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf8333-9057-457e-9393-35d704a42d90 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:53.293961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 371/749] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:53.293961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf8333-9057-457e-9393-35d704a42d90 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:53.308429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1658277-144b-4bca-8bb3-142bdf21b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:53.310074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658277-144b-4bca-8bb3-142bdf21b819 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:53.310505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658277-144b-4bca-8bb3-142bdf21b819 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:53.311192 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1658277-144b-4bca-8bb3-142bdf21b819 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:53.312553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1658277-144b-4bca-8bb3-142bdf21b819 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:53.313280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1658277-144b-4bca-8bb3-142bdf21b819 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:53.315625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1658277-144b-4bca-8bb3-142bdf21b819 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:53.338953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 379/750] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 19 15:09:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:53.340941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1658277-144b-4bca-8bb3-142bdf21b819 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:53.364148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:53.400143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf8333-9057-457e-9393-35d704a42d90 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:53.435026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988018a-e3b8-4805-bd34-cb9769c6034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:53.435650 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988018a-e3b8-4805-bd34-cb9769c6034a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:53.435886 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988018a-e3b8-4805-bd34-cb9769c6034a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:53.436155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988018a-e3b8-4805-bd34-cb9769c6034a None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:53.436836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988018a-e3b8-4805-bd34-cb9769c6034a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:53.437141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988018a-e3b8-4805-bd34-cb9769c6034a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:53.438583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988018a-e3b8-4805-bd34-cb9769c6034a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:53.445833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:53.455738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1658277-144b-4bca-8bb3-142bdf21b819 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:53.456958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 372/751] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:53.457815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988018a-e3b8-4805-bd34-cb9769c6034a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:53.493385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198020-4671-40ad-81cd-e590de0e380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:53.493988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198020-4671-40ad-81cd-e590de0e380a None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:53.494294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198020-4671-40ad-81cd-e590de0e380a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:53.494565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198020-4671-40ad-81cd-e590de0e380a None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:53.495229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77198020-4671-40ad-81cd-e590de0e380a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:53.496613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77198020-4671-40ad-81cd-e590de0e380a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:53.512788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 380/752] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:09:53 2022] POST /identity/v3/services => generated 240 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:09:53.513595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198020-4671-40ad-81cd-e590de0e380a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:53.598462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988018a-e3b8-4805-bd34-cb9769c6034a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:53.635051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:53.658840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a5e74-c1da-40be-b447-921e8aeaffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:53.659395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a5e74-c1da-40be-b447-921e8aeaffec None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:53.659668 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a5e74-c1da-40be-b447-921e8aeaffec None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:53.659933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a5e74-c1da-40be-b447-921e8aeaffec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:53.668624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a5e74-c1da-40be-b447-921e8aeaffec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:53.670076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a5e74-c1da-40be-b447-921e8aeaffec None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:53.670365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198020-4671-40ad-81cd-e590de0e380a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1f1a5e74-c1da-40be-b447-921e8aeaffec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:53.681516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:53.682523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:53.683469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:53.683469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:53.683469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:53.683469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:53.683469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:53.683469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:53.683469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:53.683469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:53.683469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:09:53.683469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:53.683469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 373/753] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 19 15:09:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:53.684098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a5e74-c1da-40be-b447-921e8aeaffec None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:53.726690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4d7f2-78e4-467f-9995-caef765bec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:53.727310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d7f2-78e4-467f-9995-caef765bec4a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:53.727587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d7f2-78e4-467f-9995-caef765bec4a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:53.727856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4d7f2-78e4-467f-9995-caef765bec4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:53.754076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:53.796970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a5e74-c1da-40be-b447-921e8aeaffec None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:53.813762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4d7f2-78e4-467f-9995-caef765bec4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:53.815263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4d7f2-78e4-467f-9995-caef765bec4a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:53.830403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa24e1-393f-4472-ada8-90239ef6484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:53.831010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa24e1-393f-4472-ada8-90239ef6484d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:53.831286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa24e1-393f-4472-ada8-90239ef6484d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:53.831550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa24e1-393f-4472-ada8-90239ef6484d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:53.832272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa24e1-393f-4472-ada8-90239ef6484d None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=62c25756d0814f1dbb8ca210ae34c892) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:53.832579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa24e1-393f-4472-ada8-90239ef6484d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:53.833994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa24e1-393f-4472-ada8-90239ef6484d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:53.839786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 374/754] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:53 2022] GET /identity/v3/role_assignments?user.id=62c25756d0814f1dbb8ca210ae34c892&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:53.841142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa24e1-393f-4472-ada8-90239ef6484d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:53.914158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:53.958444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 381/755] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:09:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:09:53.960066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87990b-382b-4e27-bdfd-33985ee48090 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:53.960625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87990b-382b-4e27-bdfd-33985ee48090 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:53.960958 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87990b-382b-4e27-bdfd-33985ee48090 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:53.966130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 382/756] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:53.967028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87990b-382b-4e27-bdfd-33985ee48090 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:54.017332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa24e1-393f-4472-ada8-90239ef6484d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:54.058267 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:54.064173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca97c8-2e0c-4db6-9c42-a7f91a652e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:54.065240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca97c8-2e0c-4db6-9c42-a7f91a652e92 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:54.065521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca97c8-2e0c-4db6-9c42-a7f91a652e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:54.065789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca97c8-2e0c-4db6-9c42-a7f91a652e92 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:54.066964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca97c8-2e0c-4db6-9c42-a7f91a652e92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:54.067555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca97c8-2e0c-4db6-9c42-a7f91a652e92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:54.069233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca97c8-2e0c-4db6-9c42-a7f91a652e92 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:54.091004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87990b-382b-4e27-bdfd-33985ee48090 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:54.092185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 375/757] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 19 15:09:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:54.093655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f309f-9542-4f39-bbf8-87008d3d6c52 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:54.093929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f309f-9542-4f39-bbf8-87008d3d6c52 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:54.094227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f309f-9542-4f39-bbf8-87008d3d6c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:54.114524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-561f309f-9542-4f39-bbf8-87008d3d6c52 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:54.115817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-561f309f-9542-4f39-bbf8-87008d3d6c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:54.127988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900104d7-9e4e-4b39-bd2b-98d7b505d456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:54.129037 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900104d7-9e4e-4b39-bd2b-98d7b505d456 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:54.129525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900104d7-9e4e-4b39-bd2b-98d7b505d456 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:54.130490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900104d7-9e4e-4b39-bd2b-98d7b505d456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:54.141938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900104d7-9e4e-4b39-bd2b-98d7b505d456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:54.143747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900104d7-9e4e-4b39-bd2b-98d7b505d456 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-900104d7-9e4e-4b39-bd2b-98d7b505d456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:54.158781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:54.159762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:54.160678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:54.160678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:54.160678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:54.162507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 383/758] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:54.163559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900104d7-9e4e-4b39-bd2b-98d7b505d456 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:54.191882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:54.199338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 376/759] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:09:54.199338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f309f-9542-4f39-bbf8-87008d3d6c52 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:54.302389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f309f-9542-4f39-bbf8-87008d3d6c52 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:54.311296 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:54.350606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900104d7-9e4e-4b39-bd2b-98d7b505d456 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:54.356803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d76e2-23b1-49fa-9ffc-b31783cb4a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:54.357809 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d76e2-23b1-49fa-9ffc-b31783cb4a23 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:54.362279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d76e2-23b1-49fa-9ffc-b31783cb4a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:54.362725 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d76e2-23b1-49fa-9ffc-b31783cb4a23 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:54.363524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d76e2-23b1-49fa-9ffc-b31783cb4a23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:54.363984 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d76e2-23b1-49fa-9ffc-b31783cb4a23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:54.365492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d76e2-23b1-49fa-9ffc-b31783cb4a23 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:54.385319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 377/760] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:54.391678 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d76e2-23b1-49fa-9ffc-b31783cb4a23 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:54.414548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034a434-d018-4c30-a475-190b3ae8b5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:54.415575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034a434-d018-4c30-a475-190b3ae8b5f7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:54.416970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034a434-d018-4c30-a475-190b3ae8b5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:54.417719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034a434-d018-4c30-a475-190b3ae8b5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:54.439046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034a434-d018-4c30-a475-190b3ae8b5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:54.441623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034a434-d018-4c30-a475-190b3ae8b5f7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d034a434-d018-4c30-a475-190b3ae8b5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:54.459340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:54.460455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:54.461525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:54.461525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:54.461525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:54.465563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 384/761] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:54.466757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034a434-d018-4c30-a475-190b3ae8b5f7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:54.565023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d76e2-23b1-49fa-9ffc-b31783cb4a23 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:54.580829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:54.605168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034a434-d018-4c30-a475-190b3ae8b5f7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:54.612159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13063c6f-d226-44f3-8ce2-93a367984244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:54.613445 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13063c6f-d226-44f3-8ce2-93a367984244 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:54.613895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13063c6f-d226-44f3-8ce2-93a367984244 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:54.614344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13063c6f-d226-44f3-8ce2-93a367984244 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:54.623935 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13063c6f-d226-44f3-8ce2-93a367984244 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:54.625530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13063c6f-d226-44f3-8ce2-93a367984244 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-13063c6f-d226-44f3-8ce2-93a367984244 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:54.641019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:54.642146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:54.643172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:54.643172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:54.643172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:54.643172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:54.643172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:54.643172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:54.643172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:54.643172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:54.643589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c3a82-8b4a-4963-827c-864d06ad71c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:54.643589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c3a82-8b4a-4963-827c-864d06ad71c9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:54.643589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c3a82-8b4a-4963-827c-864d06ad71c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:54.643886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c3a82-8b4a-4963-827c-864d06ad71c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:54.644808 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c3a82-8b4a-4963-827c-864d06ad71c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:54.645205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c3a82-8b4a-4963-827c-864d06ad71c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:54.645731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 378/762] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:54.646681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13063c6f-d226-44f3-8ce2-93a367984244 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:54.651219 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c3a82-8b4a-4963-827c-864d06ad71c9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:54.668859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 385/763] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:54.668859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c3a82-8b4a-4963-827c-864d06ad71c9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:54.705990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:54.768081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c3a82-8b4a-4963-827c-864d06ad71c9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:54.776683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13063c6f-d226-44f3-8ce2-93a367984244 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:54.802955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396948ed-a3b7-4e63-bd37-1ab67d129087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:54.803564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396948ed-a3b7-4e63-bd37-1ab67d129087 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:54.803847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396948ed-a3b7-4e63-bd37-1ab67d129087 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:54.804133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396948ed-a3b7-4e63-bd37-1ab67d129087 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:54.804820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396948ed-a3b7-4e63-bd37-1ab67d129087 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:54.805123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396948ed-a3b7-4e63-bd37-1ab67d129087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:54.806600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396948ed-a3b7-4e63-bd37-1ab67d129087 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:54.814162 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:54.822106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 386/764] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:54.823236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396948ed-a3b7-4e63-bd37-1ab67d129087 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:54.831164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925deeb-6732-4df6-b4d0-d764f01de809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:54.832067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925deeb-6732-4df6-b4d0-d764f01de809 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:54.832558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925deeb-6732-4df6-b4d0-d764f01de809 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:54.833065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925deeb-6732-4df6-b4d0-d764f01de809 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:54.833909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925deeb-6732-4df6-b4d0-d764f01de809 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:54.835555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925deeb-6732-4df6-b4d0-d764f01de809 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-3925deeb-6732-4df6-b4d0-d764f01de809 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:54.845373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:54.846382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:09:54.847207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:54.849983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 379/765] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Aug 19 15:09:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:54.851169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925deeb-6732-4df6-b4d0-d764f01de809 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:54.936153 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396948ed-a3b7-4e63-bd37-1ab67d129087 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:54.954403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:54.958061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925deeb-6732-4df6-b4d0-d764f01de809 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:54.973613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efe18b-b657-45e4-b1b1-e37311963e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:54.974273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efe18b-b657-45e4-b1b1-e37311963e49 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:54.974554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efe18b-b657-45e4-b1b1-e37311963e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:54.974824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efe18b-b657-45e4-b1b1-e37311963e49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:54.982959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efe18b-b657-45e4-b1b1-e37311963e49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:54.984537 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efe18b-b657-45e4-b1b1-e37311963e49 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b4efe18b-b657-45e4-b1b1-e37311963e49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:54.996618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:54.997517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:54.998841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:54.998841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:54.998841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:54.998841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:54.998841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:54.998841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:54.998841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:54.998841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:54.998841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 387/766] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:54.999328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efe18b-b657-45e4-b1b1-e37311963e49 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:55.001811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dcc3c-7267-4cad-9590-a01ba8eacecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:55.002710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dcc3c-7267-4cad-9590-a01ba8eacecb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:55.004071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dcc3c-7267-4cad-9590-a01ba8eacecb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:55.004340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dcc3c-7267-4cad-9590-a01ba8eacecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:55.005078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dcc3c-7267-4cad-9590-a01ba8eacecb None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=8e2cfbdc26484ae68545115f9751d482) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:55.005393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dcc3c-7267-4cad-9590-a01ba8eacecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:55.006854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dcc3c-7267-4cad-9590-a01ba8eacecb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:55.015625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 380/767] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:09:54 2022] GET /identity/v3/role_assignments?user.id=8e2cfbdc26484ae68545115f9751d482&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:55.016443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dcc3c-7267-4cad-9590-a01ba8eacecb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:55.112281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:55.191675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efe18b-b657-45e4-b1b1-e37311963e49 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:55.230011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dcc3c-7267-4cad-9590-a01ba8eacecb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:55.267680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491edd6-d284-4e6c-a96b-e11f7f467b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:55.268555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491edd6-d284-4e6c-a96b-e11f7f467b91 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:55.268800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53200530-d8a9-463c-8cb7-479baffa525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:55.269245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491edd6-d284-4e6c-a96b-e11f7f467b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:55.269413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53200530-d8a9-463c-8cb7-479baffa525e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:55.269696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53200530-d8a9-463c-8cb7-479baffa525e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:55.269971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53200530-d8a9-463c-8cb7-479baffa525e None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:55.270110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491edd6-d284-4e6c-a96b-e11f7f467b91 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:55.270691 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53200530-d8a9-463c-8cb7-479baffa525e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:55.270996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53200530-d8a9-463c-8cb7-479baffa525e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:55.271219 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491edd6-d284-4e6c-a96b-e11f7f467b91 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:55.271666 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491edd6-d284-4e6c-a96b-e11f7f467b91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:55.272425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53200530-d8a9-463c-8cb7-479baffa525e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:55.273337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491edd6-d284-4e6c-a96b-e11f7f467b91 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:55.287385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 381/768] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:55.288174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 388/769] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 19 15:09:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:55.293586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53200530-d8a9-463c-8cb7-479baffa525e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:55.294634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491edd6-d284-4e6c-a96b-e11f7f467b91 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:55.326434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:55.468062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491edd6-d284-4e6c-a96b-e11f7f467b91 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:55.495495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:55.510594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c028e43-3db8-4eac-80fe-1bf3a3c7810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:55.511938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c028e43-3db8-4eac-80fe-1bf3a3c7810f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:55.512400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c028e43-3db8-4eac-80fe-1bf3a3c7810f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:55.512824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c028e43-3db8-4eac-80fe-1bf3a3c7810f None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:55.513620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c028e43-3db8-4eac-80fe-1bf3a3c7810f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:55.514096 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c028e43-3db8-4eac-80fe-1bf3a3c7810f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:55.516090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c028e43-3db8-4eac-80fe-1bf3a3c7810f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:55.516823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53200530-d8a9-463c-8cb7-479baffa525e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:55.522721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 389/770] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 19 15:09:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:55.531970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c028e43-3db8-4eac-80fe-1bf3a3c7810f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:55.608727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00b58-a2b3-447c-961c-42882443c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:55.609549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00b58-a2b3-447c-961c-42882443c3d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:55.609957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00b58-a2b3-447c-961c-42882443c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:55.610356 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00b58-a2b3-447c-961c-42882443c3d6 None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/a86ca59cbf894c508b3439b08715da86/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:55.613910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc00b58-a2b3-447c-961c-42882443c3d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=a86ca59cbf894c508b3439b08715da86, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:55.613910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc00b58-a2b3-447c-961c-42882443c3d6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:55.642538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 382/771] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:09:55 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/a86ca59cbf894c508b3439b08715da86/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:09:55.650123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c028e43-3db8-4eac-80fe-1bf3a3c7810f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:55.676222 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830030a9-20e5-4ff9-892d-18a789524e4d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:55.676549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830030a9-20e5-4ff9-892d-18a789524e4d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:55.676782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830030a9-20e5-4ff9-892d-18a789524e4d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:55.678487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 383/772] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:09:55.683999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545027a-ee92-40e4-b613-84515102bbee None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:55.684321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545027a-ee92-40e4-b613-84515102bbee None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:55.684557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545027a-ee92-40e4-b613-84515102bbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:55.698853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d0160-dae5-4641-b711-d387499ed48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:55.699942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0160-dae5-4641-b711-d387499ed48f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:55.700500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0160-dae5-4641-b711-d387499ed48f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:55.700970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d0160-dae5-4641-b711-d387499ed48f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:55.701963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d0160-dae5-4641-b711-d387499ed48f None admin] RBAC: Adding query filter params (interface=public, service_id=cc85193eab6c4bbda44f936a7e5f9705, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:55.702546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d0160-dae5-4641-b711-d387499ed48f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:55.704185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8545027a-ee92-40e4-b613-84515102bbee None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:55.704413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d0160-dae5-4641-b711-d387499ed48f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:55.705455 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8545027a-ee92-40e4-b613-84515102bbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:55.720084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 390/773] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 19 15:09:55 2022] GET /identity/v3/endpoints?service_id=cc85193eab6c4bbda44f936a7e5f9705&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:55.726491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d0160-dae5-4641-b711-d387499ed48f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:55.823267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:55.839394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 384/774] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:09:55.892389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d0160-dae5-4641-b711-d387499ed48f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:55.927388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ca9dd-b9ad-4da8-9b6f-f15b8b779b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:55.928007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca9dd-b9ad-4da8-9b6f-f15b8b779b6e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:55.928290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca9dd-b9ad-4da8-9b6f-f15b8b779b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:55.928560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca9dd-b9ad-4da8-9b6f-f15b8b779b6e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:55.929162 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ca9dd-b9ad-4da8-9b6f-f15b8b779b6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:55.930577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ca9dd-b9ad-4da8-9b6f-f15b8b779b6e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:55.937897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 391/775] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 19 15:09:55 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:55.950298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5b1bd-6bf3-4552-aecb-498954481b40 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:55.950740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5b1bd-6bf3-4552-aecb-498954481b40 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:55.951121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5b1bd-6bf3-4552-aecb-498954481b40 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:55.953193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 385/776] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:55.959012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f91d9c-0da7-483a-b6c5-06f36a9c4165 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:55.959305 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f91d9c-0da7-483a-b6c5-06f36a9c4165 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:55.959586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f91d9c-0da7-483a-b6c5-06f36a9c4165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:55.979542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-17f91d9c-0da7-483a-b6c5-06f36a9c4165 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:55.980727 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-17f91d9c-0da7-483a-b6c5-06f36a9c4165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:56.062654 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 392/777] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:09:56.165784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5b1bd-6bf3-4552-aecb-498954481b40 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:56.169890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:56.305586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5b1bd-6bf3-4552-aecb-498954481b40 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:56.357447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed444e6-1967-4ca5-afb4-59278b34c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:56.358121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed444e6-1967-4ca5-afb4-59278b34c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:56.358408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed444e6-1967-4ca5-afb4-59278b34c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:56.358684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed444e6-1967-4ca5-afb4-59278b34c1e9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:56.359278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed444e6-1967-4ca5-afb4-59278b34c1e9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:56.360695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed444e6-1967-4ca5-afb4-59278b34c1e9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:56.374726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f91d9c-0da7-483a-b6c5-06f36a9c4165 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5ed444e6-1967-4ca5-afb4-59278b34c1e9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:56.378077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:56.379065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:56.379881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 386/778] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:56 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:56.384847 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed444e6-1967-4ca5-afb4-59278b34c1e9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:56.464583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:56.525851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:56.578231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed444e6-1967-4ca5-afb4-59278b34c1e9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:56.583056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f91d9c-0da7-483a-b6c5-06f36a9c4165 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:56.628965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87c81-6b57-4cfb-a336-9a4b6cd343eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:56.629944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d6f53-0cd5-406f-925b-9def769beefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:56.630851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87c81-6b57-4cfb-a336-9a4b6cd343eb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:56.631683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6f53-0cd5-406f-925b-9def769beefa None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:56.632167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6f53-0cd5-406f-925b-9def769beefa None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:56.632642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87c81-6b57-4cfb-a336-9a4b6cd343eb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:56.633111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d6f53-0cd5-406f-925b-9def769beefa None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:56.633587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87c81-6b57-4cfb-a336-9a4b6cd343eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:56.634488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d6f53-0cd5-406f-925b-9def769beefa None admin] RBAC: Adding query filter params (name=network) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:56.636976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d6f53-0cd5-406f-925b-9def769beefa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:56.638598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d6f53-0cd5-406f-925b-9def769beefa None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:56.648473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 387/779] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:09:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:56.656967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c87c81-6b57-4cfb-a336-9a4b6cd343eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:56.657513 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d6f53-0cd5-406f-925b-9def769beefa None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e1c87c81-6b57-4cfb-a336-9a4b6cd343eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:56.661637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:56.662572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:56.663423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 393/780] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:56.670946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87c81-6b57-4cfb-a336-9a4b6cd343eb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:56.781856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d6f53-0cd5-406f-925b-9def769beefa None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:56.813842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:56.821645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3ad3e-9546-4cbf-b36e-1128ddbadaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:56.823132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3ad3e-9546-4cbf-b36e-1128ddbadaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:56.826537 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3ad3e-9546-4cbf-b36e-1128ddbadaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:56.827080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3ad3e-9546-4cbf-b36e-1128ddbadaf6 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:56.827954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3ad3e-9546-4cbf-b36e-1128ddbadaf6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:56.828529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3ad3e-9546-4cbf-b36e-1128ddbadaf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:56.830128 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3ad3e-9546-4cbf-b36e-1128ddbadaf6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:56.839684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 388/781] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:09:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:56.847065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3ad3e-9546-4cbf-b36e-1128ddbadaf6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:56.920811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87c81-6b57-4cfb-a336-9a4b6cd343eb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:56.927073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:56.959145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3ad3e-9546-4cbf-b36e-1128ddbadaf6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:56.995525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5c366-15f5-42fd-adad-3de60cd88a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:56.996633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c366-15f5-42fd-adad-3de60cd88a6a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:56.997148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c366-15f5-42fd-adad-3de60cd88a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:56.997640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5c366-15f5-42fd-adad-3de60cd88a6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:56.998582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5c366-15f5-42fd-adad-3de60cd88a6a None admin] RBAC: Adding query filter params (interface=public, service_id=24c0566efb2b4d01b0e00581d8359ea8, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:56.999105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5c366-15f5-42fd-adad-3de60cd88a6a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:57.000673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5c366-15f5-42fd-adad-3de60cd88a6a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:57.009244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 389/782] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 19 15:09:56 2022] GET /identity/v3/endpoints?service_id=24c0566efb2b4d01b0e00581d8359ea8&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:57.010535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33c65e-9b69-49f8-b87b-a4140e606374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:57.011169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c65e-9b69-49f8-b87b-a4140e606374 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:57.011456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c65e-9b69-49f8-b87b-a4140e606374 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:57.012272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33c65e-9b69-49f8-b87b-a4140e606374 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:57.012957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33c65e-9b69-49f8-b87b-a4140e606374 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:57.013266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33c65e-9b69-49f8-b87b-a4140e606374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:57.014986 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5c366-15f5-42fd-adad-3de60cd88a6a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:57.019870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33c65e-9b69-49f8-b87b-a4140e606374 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:57.035664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 394/783] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:57.043087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33c65e-9b69-49f8-b87b-a4140e606374 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:57.120074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:57.205321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33c65e-9b69-49f8-b87b-a4140e606374 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:57.207939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5c366-15f5-42fd-adad-3de60cd88a6a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:57.240606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df391077-2f61-41fa-a613-c485c8e75575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:57.241243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df391077-2f61-41fa-a613-c485c8e75575 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:57.241539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df391077-2f61-41fa-a613-c485c8e75575 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:57.241813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df391077-2f61-41fa-a613-c485c8e75575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:57.253531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df391077-2f61-41fa-a613-c485c8e75575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:57.255159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df391077-2f61-41fa-a613-c485c8e75575 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-df391077-2f61-41fa-a613-c485c8e75575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:57.270385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:57.271353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:57.272243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:57.272243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:57.272243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:57.272243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 395/784] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:57.277576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df391077-2f61-41fa-a613-c485c8e75575 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:57.310456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:57.310823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a71aa1-d54a-47f3-9744-da4d53298535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:57.311364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a71aa1-d54a-47f3-9744-da4d53298535 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:57.311645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a71aa1-d54a-47f3-9744-da4d53298535 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:57.311919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a71aa1-d54a-47f3-9744-da4d53298535 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:57.312539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a71aa1-d54a-47f3-9744-da4d53298535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:57.313906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a71aa1-d54a-47f3-9744-da4d53298535 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:57.326333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 390/785] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 19 15:09:57 2022] GET /identity/v3/services => generated 772 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:57.387557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214442-ef68-480b-a2f8-4cbd213f2d08 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:57.387756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214442-ef68-480b-a2f8-4cbd213f2d08 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:57.388002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec214442-ef68-480b-a2f8-4cbd213f2d08 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:57.389634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 391/786] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:57.391150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df391077-2f61-41fa-a613-c485c8e75575 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:57.395344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db3d0b-387e-40d1-86a9-25e688f71447 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:57.395630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db3d0b-387e-40d1-86a9-25e688f71447 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:57.395892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db3d0b-387e-40d1-86a9-25e688f71447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:57.414796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-31db3d0b-387e-40d1-86a9-25e688f71447 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:57.415986 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-31db3d0b-387e-40d1-86a9-25e688f71447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:57.431680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2579-d19c-4b75-a426-3706426f28c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:57.432409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2579-d19c-4b75-a426-3706426f28c2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:57.432692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2579-d19c-4b75-a426-3706426f28c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:57.432967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2579-d19c-4b75-a426-3706426f28c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:57.433658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de2579-d19c-4b75-a426-3706426f28c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:57.434200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de2579-d19c-4b75-a426-3706426f28c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:57.436621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de2579-d19c-4b75-a426-3706426f28c2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:57.450924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 396/787] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:09:57.456514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2579-d19c-4b75-a426-3706426f28c2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:57.547410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:57.570782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2579-d19c-4b75-a426-3706426f28c2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:57.582445 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 392/788] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:09:57.611737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346466b6-046f-42d9-b80c-09d8503d9b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:57.612373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346466b6-046f-42d9-b80c-09d8503d9b61 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:57.612655 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346466b6-046f-42d9-b80c-09d8503d9b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:57.612929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346466b6-046f-42d9-b80c-09d8503d9b61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:57.621117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346466b6-046f-42d9-b80c-09d8503d9b61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:57.623142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346466b6-046f-42d9-b80c-09d8503d9b61 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-346466b6-046f-42d9-b80c-09d8503d9b61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:57.635007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:57.635914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:57.636884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:57.636884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:57.636884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:57.636884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:57.636884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:57.636884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:57.636884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:57.636884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:57.636884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:09:57.636884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:57.636884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 397/789] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:57.642457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db3d0b-387e-40d1-86a9-25e688f71447 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:57.700198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:57.759029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db3d0b-387e-40d1-86a9-25e688f71447 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:57.803974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcfa9d-2e0c-4bce-9619-4f24276cc281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:57.804699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcfa9d-2e0c-4bce-9619-4f24276cc281 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:57.804982 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcfa9d-2e0c-4bce-9619-4f24276cc281 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:57.805255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcfa9d-2e0c-4bce-9619-4f24276cc281 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:57.805995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcfa9d-2e0c-4bce-9619-4f24276cc281 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:57.806334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcfa9d-2e0c-4bce-9619-4f24276cc281 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:57.807760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcfa9d-2e0c-4bce-9619-4f24276cc281 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:57.832555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 393/790] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 19 15:09:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:57.838183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346466b6-046f-42d9-b80c-09d8503d9b61 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:57.903374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcfa9d-2e0c-4bce-9619-4f24276cc281 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:57.992361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346466b6-046f-42d9-b80c-09d8503d9b61 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:58.009197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcfa9d-2e0c-4bce-9619-4f24276cc281 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:58.023395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:58.039978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5084a-1d6b-4c1d-8816-a130c5772d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:58.040812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5084a-1d6b-4c1d-8816-a130c5772d41 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.041419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5084a-1d6b-4c1d-8816-a130c5772d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.041792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5084a-1d6b-4c1d-8816-a130c5772d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.049074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c21b39-6cf5-43f0-ae00-bf2b7bd2f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:58.049946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21b39-6cf5-43f0-ae00-bf2b7bd2f35f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.050426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21b39-6cf5-43f0-ae00-bf2b7bd2f35f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.050867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21b39-6cf5-43f0-ae00-bf2b7bd2f35f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.051032 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:58.056559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5084a-1d6b-4c1d-8816-a130c5772d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:58.058522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5084a-1d6b-4c1d-8816-a130c5772d41 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:58.063627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c21b39-6cf5-43f0-ae00-bf2b7bd2f35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d7c21b39-6cf5-43f0-ae00-bf2b7bd2f35f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:58.068446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:58.069364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:09:58.070528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:58.074784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 394/791] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:09:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:09:58.076112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657f93-9970-4ea3-a077-29b857791d77 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.076466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657f93-9970-4ea3-a077-29b857791d77 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.076808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94657f93-9970-4ea3-a077-29b857791d77 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e2c5084a-1d6b-4c1d-8816-a130c5772d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:58.078521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:58.079568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:58.080624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:58.080624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:58.080624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:58.080800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 395/792] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:58.080800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94657f93-9970-4ea3-a077-29b857791d77 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:58.082985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 398/793] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:58.088578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5084a-1d6b-4c1d-8816-a130c5772d41 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:58.186229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94657f93-9970-4ea3-a077-29b857791d77 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:58.203607 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5084a-1d6b-4c1d-8816-a130c5772d41 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:58.223227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85f45a-6b46-46f6-b648-c6e0285a6d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:58.223986 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f45a-6b46-46f6-b648-c6e0285a6d2e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.224486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f45a-6b46-46f6-b648-c6e0285a6d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.224754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f45a-6b46-46f6-b648-c6e0285a6d2e None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.225753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85f45a-6b46-46f6-b648-c6e0285a6d2e None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:58.226075 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85f45a-6b46-46f6-b648-c6e0285a6d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:58.227443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85f45a-6b46-46f6-b648-c6e0285a6d2e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:58.243283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 396/794] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:09:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:58.245137 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abc87-eac7-4a0a-9e0c-cd3c6c89c85d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.245436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abc87-eac7-4a0a-9e0c-cd3c6c89c85d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.245703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abc87-eac7-4a0a-9e0c-cd3c6c89c85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.249393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88926d-8514-458c-9dd3-a1d61aff6372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:58.250225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88926d-8514-458c-9dd3-a1d61aff6372 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.250560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88926d-8514-458c-9dd3-a1d61aff6372 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.250909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88926d-8514-458c-9dd3-a1d61aff6372 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.251945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88926d-8514-458c-9dd3-a1d61aff6372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:58.252320 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88926d-8514-458c-9dd3-a1d61aff6372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:58.254761 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88926d-8514-458c-9dd3-a1d61aff6372 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:58.264959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-de9abc87-eac7-4a0a-9e0c-cd3c6c89c85d None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:58.266785 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-de9abc87-eac7-4a0a-9e0c-cd3c6c89c85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:58.269247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 399/795] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:58.271223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88926d-8514-458c-9dd3-a1d61aff6372 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:58.300173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:58.339047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:58.358055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 397/796] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:09:58.358055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9abc87-eac7-4a0a-9e0c-cd3c6c89c85d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:58.434075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88926d-8514-458c-9dd3-a1d61aff6372 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:58.466481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44e5aa-dc17-41f7-99d2-13cb34b561c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:58.467090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44e5aa-dc17-41f7-99d2-13cb34b561c0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.467373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44e5aa-dc17-41f7-99d2-13cb34b561c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.467702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44e5aa-dc17-41f7-99d2-13cb34b561c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.477995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44e5aa-dc17-41f7-99d2-13cb34b561c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:58.479738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44e5aa-dc17-41f7-99d2-13cb34b561c0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1e44e5aa-dc17-41f7-99d2-13cb34b561c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:58.494476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:58.495472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:58.496390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:58.496390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:58.496390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:58.496390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 400/797] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:58.497258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b152a-6559-4512-92e2-d9674907cff4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.497546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b152a-6559-4512-92e2-d9674907cff4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.497824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b152a-6559-4512-92e2-d9674907cff4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.499342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 401/798] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:58.501173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b152a-6559-4512-92e2-d9674907cff4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:58.507593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9abc87-eac7-4a0a-9e0c-cd3c6c89c85d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:58.552196 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc046ba-2c0d-48d0-a5ec-901142443ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:58.553030 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc046ba-2c0d-48d0-a5ec-901142443ecf None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.553438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc046ba-2c0d-48d0-a5ec-901142443ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.553809 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc046ba-2c0d-48d0-a5ec-901142443ecf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.563979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc046ba-2c0d-48d0-a5ec-901142443ecf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:58.566090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc046ba-2c0d-48d0-a5ec-901142443ecf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-dfc046ba-2c0d-48d0-a5ec-901142443ecf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:09:58.582333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:58.583414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:58.584526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:09:58.584526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:09:58.584526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:09:58.584526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:09:58.584526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:09:58.584526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:09:58.584526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:09:58.584526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:58.590352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 398/799] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:09:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:58.590352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467d5ef-ca9c-4a95-9862-5ae0662b26d8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.590352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467d5ef-ca9c-4a95-9862-5ae0662b26d8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.590352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467d5ef-ca9c-4a95-9862-5ae0662b26d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.611160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9467d5ef-ca9c-4a95-9862-5ae0662b26d8 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:58.612817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9467d5ef-ca9c-4a95-9862-5ae0662b26d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:58.631569 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:58.636967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b152a-6559-4512-92e2-d9674907cff4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:58.639446 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:58.682696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0ff55-efa7-41bd-8b98-3cd44d781fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:58.683586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0ff55-efa7-41bd-8b98-3cd44d781fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.683871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0ff55-efa7-41bd-8b98-3cd44d781fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.684154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0ff55-efa7-41bd-8b98-3cd44d781fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.684799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0ff55-efa7-41bd-8b98-3cd44d781fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:58.685105 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0ff55-efa7-41bd-8b98-3cd44d781fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:58.686499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0ff55-efa7-41bd-8b98-3cd44d781fd1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:58.698054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 399/800] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:09:58.698054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467d5ef-ca9c-4a95-9862-5ae0662b26d8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:58.702406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 402/801] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:58.703279 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0ff55-efa7-41bd-8b98-3cd44d781fd1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:58.814390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467d5ef-ca9c-4a95-9862-5ae0662b26d8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:58.821210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0ff55-efa7-41bd-8b98-3cd44d781fd1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:58.851881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c26e43-8ad6-4875-a026-4f3fc4f54d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:58.852781 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c26e43-8ad6-4875-a026-4f3fc4f54d16 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.853323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c26e43-8ad6-4875-a026-4f3fc4f54d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.853824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c26e43-8ad6-4875-a026-4f3fc4f54d16 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.855062 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c26e43-8ad6-4875-a026-4f3fc4f54d16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:58.856206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c26e43-8ad6-4875-a026-4f3fc4f54d16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:58.857835 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c26e43-8ad6-4875-a026-4f3fc4f54d16 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:58.865832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37202-003b-4640-b831-2c6641920825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:58.866492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37202-003b-4640-b831-2c6641920825 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:58.866776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37202-003b-4640-b831-2c6641920825 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:58.867052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37202-003b-4640-b831-2c6641920825 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:58.876270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 400/802] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:09:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:58.877380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c26e43-8ad6-4875-a026-4f3fc4f54d16 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:58.878995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d37202-003b-4640-b831-2c6641920825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-35d37202-003b-4640-b831-2c6641920825 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:09:58.885391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:58.886379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:09:58.887275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 403/803] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:09:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:58.887978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37202-003b-4640-b831-2c6641920825 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:58.900994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:58.917584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:59.002933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37202-003b-4640-b831-2c6641920825 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:59.006501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c26e43-8ad6-4875-a026-4f3fc4f54d16 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:59.038673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04080f-ff1c-4fe0-bc31-b0495fee2ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:59.039335 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04080f-ff1c-4fe0-bc31-b0495fee2ca0 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.039620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04080f-ff1c-4fe0-bc31-b0495fee2ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.039927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04080f-ff1c-4fe0-bc31-b0495fee2ca0 None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/62c25756d0814f1dbb8ca210ae34c892/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.041846 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04080f-ff1c-4fe0-bc31-b0495fee2ca0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=62c25756d0814f1dbb8ca210ae34c892, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:59.043386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04080f-ff1c-4fe0-bc31-b0495fee2ca0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:59.046097 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040a77d-bcb1-429c-b9e4-adcfd7115ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:59.047317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040a77d-bcb1-429c-b9e4-adcfd7115ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.047647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040a77d-bcb1-429c-b9e4-adcfd7115ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.047953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040a77d-bcb1-429c-b9e4-adcfd7115ac8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.057253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040a77d-bcb1-429c-b9e4-adcfd7115ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:59.066452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 404/804] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:09:58 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/62c25756d0814f1dbb8ca210ae34c892/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:09:59.066632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040a77d-bcb1-429c-b9e4-adcfd7115ac8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:59.066739 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04080f-ff1c-4fe0-bc31-b0495fee2ca0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b040a77d-bcb1-429c-b9e4-adcfd7115ac8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:09:59.081510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:59.082567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:59.083506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:59.083506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:59.083506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:09:59.083506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:09:59.083506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:09:59.083506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:09:59.083506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:09:59.083506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:09:59.083506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:09:59.083506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:59.087667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 401/805] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 19 15:09:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:59.088742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040a77d-bcb1-429c-b9e4-adcfd7115ac8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:59.175401 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:59.197337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04080f-ff1c-4fe0-bc31-b0495fee2ca0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:59.198697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:59.238928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040a77d-bcb1-429c-b9e4-adcfd7115ac8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:59.246497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a28e23-698a-4202-962a-d363bbf44c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:59.246497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28e23-698a-4202-962a-d363bbf44c71 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.246497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28e23-698a-4202-962a-d363bbf44c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.246497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28e23-698a-4202-962a-d363bbf44c71 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.247724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a28e23-698a-4202-962a-d363bbf44c71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:59.248085 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a28e23-698a-4202-962a-d363bbf44c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:59.249850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a28e23-698a-4202-962a-d363bbf44c71 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:59.259609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 405/806] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:09:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:59.260294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a28e23-698a-4202-962a-d363bbf44c71 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:59.285499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353b187-4a48-4d4e-b605-06b03a388991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:59.286168 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b187-4a48-4d4e-b605-06b03a388991 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.286453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b187-4a48-4d4e-b605-06b03a388991 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.286731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b187-4a48-4d4e-b605-06b03a388991 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.287371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353b187-4a48-4d4e-b605-06b03a388991 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:59.288745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353b187-4a48-4d4e-b605-06b03a388991 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d353b187-4a48-4d4e-b605-06b03a388991 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:59.305381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:59.306423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:59.307254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 402/807] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Aug 19 15:09:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:59.308032 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353b187-4a48-4d4e-b605-06b03a388991 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:59.382120 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a28e23-698a-4202-962a-d363bbf44c71 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:59.426395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf26ed-fd19-4f44-a775-f8ceb5df291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:59.427387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf26ed-fd19-4f44-a775-f8ceb5df291c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.427769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf26ed-fd19-4f44-a775-f8ceb5df291c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.428501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf26ed-fd19-4f44-a775-f8ceb5df291c None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.429843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf26ed-fd19-4f44-a775-f8ceb5df291c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:59.430302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf26ed-fd19-4f44-a775-f8ceb5df291c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:59.431446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353b187-4a48-4d4e-b605-06b03a388991 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:59.431996 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf26ed-fd19-4f44-a775-f8ceb5df291c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:59.458182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 406/808] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 19 15:09:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:59.459690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf26ed-fd19-4f44-a775-f8ceb5df291c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:59.462943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:59.478451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4a139-5559-4192-a909-60163a5c5791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:59.479589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4a139-5559-4192-a909-60163a5c5791 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.480190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4a139-5559-4192-a909-60163a5c5791 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.480588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4a139-5559-4192-a909-60163a5c5791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.494430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:59.498893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4a139-5559-4192-a909-60163a5c5791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:59.500878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4a139-5559-4192-a909-60163a5c5791 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-eef4a139-5559-4192-a909-60163a5c5791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:59.521694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:59.522752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:59.523628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:59.523628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:59.523628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:59.526105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 403/809] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:59.527183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4a139-5559-4192-a909-60163a5c5791 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:59.597087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf26ed-fd19-4f44-a775-f8ceb5df291c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:59.632657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7f9b8-bcea-4492-ae4b-f3dd7cda34f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:59.633187 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7f9b8-bcea-4492-ae4b-f3dd7cda34f8 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.633473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7f9b8-bcea-4492-ae4b-f3dd7cda34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.633745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7f9b8-bcea-4492-ae4b-f3dd7cda34f8 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.634421 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7f9b8-bcea-4492-ae4b-f3dd7cda34f8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:59.634705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7f9b8-bcea-4492-ae4b-f3dd7cda34f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:59.636075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7f9b8-bcea-4492-ae4b-f3dd7cda34f8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:59.637566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4a139-5559-4192-a909-60163a5c5791 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:59.645763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 407/810] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 19 15:09:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:59.645763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7f9b8-bcea-4492-ae4b-f3dd7cda34f8 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:59.675069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b79fc-e2b0-4b7d-8be6-042403b9421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:59.675693 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b79fc-e2b0-4b7d-8be6-042403b9421a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.675975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b79fc-e2b0-4b7d-8be6-042403b9421a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.676249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b79fc-e2b0-4b7d-8be6-042403b9421a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.687579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b79fc-e2b0-4b7d-8be6-042403b9421a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:59.689021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b79fc-e2b0-4b7d-8be6-042403b9421a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ca3b79fc-e2b0-4b7d-8be6-042403b9421a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:09:59.703022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:09:59.703928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:09:59.704815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:09:59.704815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:09:59.704815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:09:59.704815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 404/811] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:09:59.705434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a13b-bc34-4941-9a5f-f22a66e44fed None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.705547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a13b-bc34-4941-9a5f-f22a66e44fed None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.705756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a13b-bc34-4941-9a5f-f22a66e44fed None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.710407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 405/812] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:09:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:09:59.710407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548a13b-bc34-4941-9a5f-f22a66e44fed None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:59.714877 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:59.753517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7f9b8-bcea-4492-ae4b-f3dd7cda34f8 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:59.758953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:59.788415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d7ee8-6cf3-4df7-b478-a865f3c41973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:59.788415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d7ee8-6cf3-4df7-b478-a865f3c41973 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.788676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d7ee8-6cf3-4df7-b478-a865f3c41973 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.788924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d7ee8-6cf3-4df7-b478-a865f3c41973 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.789495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d7ee8-6cf3-4df7-b478-a865f3c41973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:59.789797 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d7ee8-6cf3-4df7-b478-a865f3c41973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:59.791207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d7ee8-6cf3-4df7-b478-a865f3c41973 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:59.809546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 408/813] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:59.809546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d7ee8-6cf3-4df7-b478-a865f3c41973 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:59.822956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548a13b-bc34-4941-9a5f-f22a66e44fed None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:59.860483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bd9cf-1420-4223-9e8c-98d55e01018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:59.861085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bd9cf-1420-4223-9e8c-98d55e01018a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.861368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bd9cf-1420-4223-9e8c-98d55e01018a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.861639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bd9cf-1420-4223-9e8c-98d55e01018a None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.862296 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bd9cf-1420-4223-9e8c-98d55e01018a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:59.862602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bd9cf-1420-4223-9e8c-98d55e01018a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:59.863963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490bd9cf-1420-4223-9e8c-98d55e01018a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:59.874041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 406/814] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Aug 19 15:09:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:59.874041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05102b94-c2c5-46e5-9b66-f6adaa9da0d1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.874041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05102b94-c2c5-46e5-9b66-f6adaa9da0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.874041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05102b94-c2c5-46e5-9b66-f6adaa9da0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.888523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-05102b94-c2c5-46e5-9b66-f6adaa9da0d1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:09:59.889656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-05102b94-c2c5-46e5-9b66-f6adaa9da0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:09:59.918856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d7ee8-6cf3-4df7-b478-a865f3c41973 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:09:59.946510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:09:59.955739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 407/815] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:09:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:09:59.956410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05102b94-c2c5-46e5-9b66-f6adaa9da0d1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:09:59.967071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16977b7-e226-4e74-aaad-b59a402deb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:09:59.967696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16977b7-e226-4e74-aaad-b59a402deb2d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:09:59.967982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16977b7-e226-4e74-aaad-b59a402deb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:09:59.968259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16977b7-e226-4e74-aaad-b59a402deb2d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:09:59.968903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16977b7-e226-4e74-aaad-b59a402deb2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:09:59.969206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16977b7-e226-4e74-aaad-b59a402deb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:09:59.970592 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16977b7-e226-4e74-aaad-b59a402deb2d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:09:59.993829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 409/816] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:09:59.993829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16977b7-e226-4e74-aaad-b59a402deb2d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:00.007838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:00.094411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05102b94-c2c5-46e5-9b66-f6adaa9da0d1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:00.111722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16977b7-e226-4e74-aaad-b59a402deb2d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:00.141025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925115d-4472-4765-8384-fc16dd11f7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:00.142310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925115d-4472-4765-8384-fc16dd11f7fe None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:00.143201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925115d-4472-4765-8384-fc16dd11f7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:00.143919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925115d-4472-4765-8384-fc16dd11f7fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:00.147744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c20b2-8409-4497-93d3-6746a97cb492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:00.148424 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c20b2-8409-4497-93d3-6746a97cb492 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:00.148771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c20b2-8409-4497-93d3-6746a97cb492 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:00.149107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c20b2-8409-4497-93d3-6746a97cb492 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:00.149845 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c20b2-8409-4497-93d3-6746a97cb492 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:00.151298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29c20b2-8409-4497-93d3-6746a97cb492 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:00.153815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925115d-4472-4765-8384-fc16dd11f7fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:00.155803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925115d-4472-4765-8384-fc16dd11f7fe None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1925115d-4472-4765-8384-fc16dd11f7fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:10:00.171621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:00.172683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:00.173619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:00.173619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:00.173619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:10:00.173619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:10:00.173619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:10:00.173619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:10:00.173619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:10:00.173619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:10:00.173619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:10:00.173619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:00.176253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 408/817] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 19 15:09:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:00.177324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925115d-4472-4765-8384-fc16dd11f7fe None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:00.182934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 410/818] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:09:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:10:00.188961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c20b2-8409-4497-93d3-6746a97cb492 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:00.269739 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:00.314391 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:00.321313 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925115d-4472-4765-8384-fc16dd11f7fe None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:00.365690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c20b2-8409-4497-93d3-6746a97cb492 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:00.369474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ba598-dfb4-41a0-8c40-5ed74c89c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:00.370138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ba598-dfb4-41a0-8c40-5ed74c89c0dc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:00.370415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ba598-dfb4-41a0-8c40-5ed74c89c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:00.370685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ba598-dfb4-41a0-8c40-5ed74c89c0dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:00.378989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ba598-dfb4-41a0-8c40-5ed74c89c0dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:00.380420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ba598-dfb4-41a0-8c40-5ed74c89c0dc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-137ba598-dfb4-41a0-8c40-5ed74c89c0dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:10:00.392393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:00.393278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:00.394271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:10:00.394271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:10:00.394271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:10:00.394271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:10:00.394271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:10:00.394271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:10:00.394271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:00.394271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:00.394271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 409/819] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:00.394796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ba598-dfb4-41a0-8c40-5ed74c89c0dc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:00.406408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a6ca2-93cc-4829-a6bf-2532cd967ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:00.407018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a6ca2-93cc-4829-a6bf-2532cd967ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:00.407295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a6ca2-93cc-4829-a6bf-2532cd967ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:00.407566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a6ca2-93cc-4829-a6bf-2532cd967ce2 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:00.408290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a6ca2-93cc-4829-a6bf-2532cd967ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:00.408590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a6ca2-93cc-4829-a6bf-2532cd967ce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:00.410011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a6ca2-93cc-4829-a6bf-2532cd967ce2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:00.428386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 411/820] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 19 15:10:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:00.429051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a6ca2-93cc-4829-a6bf-2532cd967ce2 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:00.532088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ba598-dfb4-41a0-8c40-5ed74c89c0dc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:00.538913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:00.545852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a6ca2-93cc-4829-a6bf-2532cd967ce2 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:00.578965 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ffd9d-0e95-49df-9cbe-d7a4aeb652ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:00.580035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ffd9d-0e95-49df-9cbe-d7a4aeb652ce None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:00.580638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ffd9d-0e95-49df-9cbe-d7a4aeb652ce None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:00.581102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ffd9d-0e95-49df-9cbe-d7a4aeb652ce None admin] PATH_INFO: `/v3/services/network` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:00.582481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ffd9d-0e95-49df-9cbe-d7a4aeb652ce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:00.584423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ffd9d-0e95-49df-9cbe-d7a4aeb652ce None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:00.586686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00a8c9-d6c4-4d1c-975c-c07e3e9b608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:00.587414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a8c9-d6c4-4d1c-975c-c07e3e9b608a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:00.587788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a8c9-d6c4-4d1c-975c-c07e3e9b608a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:00.588240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00a8c9-d6c4-4d1c-975c-c07e3e9b608a None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:00.588943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00a8c9-d6c4-4d1c-975c-c07e3e9b608a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:00.589322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00a8c9-d6c4-4d1c-975c-c07e3e9b608a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:00.591572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00a8c9-d6c4-4d1c-975c-c07e3e9b608a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-079ffd9d-0e95-49df-9cbe-d7a4aeb652ce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:00.597323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:00.598340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 15:10:00.599191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:00.601994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 410/821] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:00 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:00.603774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ffd9d-0e95-49df-9cbe-d7a4aeb652ce None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:00.610769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 412/822] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:00.610769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00a8c9-d6c4-4d1c-975c-c07e3e9b608a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:00.637162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:00.732039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ffd9d-0e95-49df-9cbe-d7a4aeb652ce None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:00.742778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00a8c9-d6c4-4d1c-975c-c07e3e9b608a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:00.773610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22d2b-2f92-407f-94ec-fece73e3bf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:00.774254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22d2b-2f92-407f-94ec-fece73e3bf47 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:00.774531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22d2b-2f92-407f-94ec-fece73e3bf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:00.774800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22d2b-2f92-407f-94ec-fece73e3bf47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:00.789931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e16f9-32f7-4ef5-89f0-e97daa1542ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:00.790815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e16f9-32f7-4ef5-89f0-e97daa1542ad None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:00.791686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e16f9-32f7-4ef5-89f0-e97daa1542ad None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:00.791966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e16f9-32f7-4ef5-89f0-e97daa1542ad None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:00.792893 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e16f9-32f7-4ef5-89f0-e97daa1542ad None admin] RBAC: Adding query filter params (name=network) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:00.793209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e16f9-32f7-4ef5-89f0-e97daa1542ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:00.795219 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e16f9-32f7-4ef5-89f0-e97daa1542ad None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:00.802392 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 413/823] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:10:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:00.803235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e16f9-32f7-4ef5-89f0-e97daa1542ad None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:00.828744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:00.872461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b22d2b-2f92-407f-94ec-fece73e3bf47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:00.874507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b22d2b-2f92-407f-94ec-fece73e3bf47 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:00.896117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:00.912503 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e16f9-32f7-4ef5-89f0-e97daa1542ad None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:00.958318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e0e22-f686-4ba4-9d4e-c56e3d466eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:00.958982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e0e22-f686-4ba4-9d4e-c56e3d466eb1 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:00.959262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e0e22-f686-4ba4-9d4e-c56e3d466eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:00.959536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e0e22-f686-4ba4-9d4e-c56e3d466eb1 None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/8e2cfbdc26484ae68545115f9751d482/roles/07f9b55cf8dc408984d3e199f474cb91` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:00.978253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e0e22-f686-4ba4-9d4e-c56e3d466eb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=8e2cfbdc26484ae68545115f9751d482, role_id=07f9b55cf8dc408984d3e199f474cb91)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:00.980702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e0e22-f686-4ba4-9d4e-c56e3d466eb1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:00.988839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 411/824] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:10:00.989708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22d2b-2f92-407f-94ec-fece73e3bf47 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:01.004926 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 414/825] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:10:00 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/8e2cfbdc26484ae68545115f9751d482/roles/07f9b55cf8dc408984d3e199f474cb91 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:10:01.006178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e0e22-f686-4ba4-9d4e-c56e3d466eb1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:01.110101 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:01.119852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22d2b-2f92-407f-94ec-fece73e3bf47 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:01.148053 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:01.150070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e0e22-f686-4ba4-9d4e-c56e3d466eb1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:01.174368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98726f-839c-4e9b-8317-3d69575675a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:01.175313 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98726f-839c-4e9b-8317-3d69575675a6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:01.175768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98726f-839c-4e9b-8317-3d69575675a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:01.176214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98726f-839c-4e9b-8317-3d69575675a6 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:01.177142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98726f-839c-4e9b-8317-3d69575675a6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:01.177670 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98726f-839c-4e9b-8317-3d69575675a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:01.179256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98726f-839c-4e9b-8317-3d69575675a6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:01.185368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 412/826] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:10:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:01.186611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca641e8-d4a2-4d0d-bdff-60aed9b70b59 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:01.186870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca641e8-d4a2-4d0d-bdff-60aed9b70b59 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:01.187156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca641e8-d4a2-4d0d-bdff-60aed9b70b59 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:01.188583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 413/827] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:01.192031 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca641e8-d4a2-4d0d-bdff-60aed9b70b59 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:01.192160 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e408f7-41b9-49b5-8b9e-bd9b6a3d92f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:01.192803 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e408f7-41b9-49b5-8b9e-bd9b6a3d92f3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:01.192996 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e408f7-41b9-49b5-8b9e-bd9b6a3d92f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:01.193273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e408f7-41b9-49b5-8b9e-bd9b6a3d92f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:01.205772 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e408f7-41b9-49b5-8b9e-bd9b6a3d92f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:01.207337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e408f7-41b9-49b5-8b9e-bd9b6a3d92f3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a5e408f7-41b9-49b5-8b9e-bd9b6a3d92f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:01.224523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:01.225510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:01.227354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:01.227354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:01.227354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:01.227354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 415/828] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:01.227354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08d7b-3bd9-41eb-8bf0-1b57a6a549b9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:01.227354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08d7b-3bd9-41eb-8bf0-1b57a6a549b9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:01.227693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08d7b-3bd9-41eb-8bf0-1b57a6a549b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:01.247512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bde08d7b-3bd9-41eb-8bf0-1b57a6a549b9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:01.248648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bde08d7b-3bd9-41eb-8bf0-1b57a6a549b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:01.324212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 416/829] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:01.325147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde08d7b-3bd9-41eb-8bf0-1b57a6a549b9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:01.335447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca641e8-d4a2-4d0d-bdff-60aed9b70b59 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:01.405896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f58741-9ac7-4d89-99fe-204f08c6b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:01.406551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f58741-9ac7-4d89-99fe-204f08c6b35e None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:01.406829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f58741-9ac7-4d89-99fe-204f08c6b35e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:01.407104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f58741-9ac7-4d89-99fe-204f08c6b35e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:01.407772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f58741-9ac7-4d89-99fe-204f08c6b35e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:01.412534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f58741-9ac7-4d89-99fe-204f08c6b35e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:01.437283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:01.461335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 414/830] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:10:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:10:01.506531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde08d7b-3bd9-41eb-8bf0-1b57a6a549b9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:01.564817 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95429ddd-23ed-426b-834a-ac03dbd68f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:01.566253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95429ddd-23ed-426b-834a-ac03dbd68f8d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:01.566798 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95429ddd-23ed-426b-834a-ac03dbd68f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:01.567278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95429ddd-23ed-426b-834a-ac03dbd68f8d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:01.568326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95429ddd-23ed-426b-834a-ac03dbd68f8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:01.568839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95429ddd-23ed-426b-834a-ac03dbd68f8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:01.570509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95429ddd-23ed-426b-834a-ac03dbd68f8d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:01.589049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 417/831] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:01.595023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f58741-9ac7-4d89-99fe-204f08c6b35e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:01.663320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:01.665752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95429ddd-23ed-426b-834a-ac03dbd68f8d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:01.759119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f58741-9ac7-4d89-99fe-204f08c6b35e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:01.776015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95429ddd-23ed-426b-834a-ac03dbd68f8d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:01.786893 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:01.799172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507749a-524d-4a73-a1a0-7b5437c7a769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:01.800064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507749a-524d-4a73-a1a0-7b5437c7a769 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:01.800064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507749a-524d-4a73-a1a0-7b5437c7a769 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:01.800335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507749a-524d-4a73-a1a0-7b5437c7a769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:01.807430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507749a-524d-4a73-a1a0-7b5437c7a769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:01.808935 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507749a-524d-4a73-a1a0-7b5437c7a769 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:01.819837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a3802-fae0-4918-8dbf-28bbd19c3ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:01.819837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3802-fae0-4918-8dbf-28bbd19c3ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:01.819837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3802-fae0-4918-8dbf-28bbd19c3ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:01.820163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a3802-fae0-4918-8dbf-28bbd19c3ad4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0507749a-524d-4a73-a1a0-7b5437c7a769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:10:01.826940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:01.827819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:01.828687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:10:01.828687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:10:01.828687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:10:01.828687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:10:01.828687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:10:01.828687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:10:01.828687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:01.828687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:01.832812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 415/832] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:01.834146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507749a-524d-4a73-a1a0-7b5437c7a769 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:01.841990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a3802-fae0-4918-8dbf-28bbd19c3ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-dd7a3802-fae0-4918-8dbf-28bbd19c3ad4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:01.849036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:01.849951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:01.850820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:01.851441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 418/833] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:01.858012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a3802-fae0-4918-8dbf-28bbd19c3ad4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:01.949010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:01.955753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507749a-524d-4a73-a1a0-7b5437c7a769 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:01.979365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a3802-fae0-4918-8dbf-28bbd19c3ad4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:01.992535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50534543-2ba1-48f9-8fd1-dfe83c11c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:01.993147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50534543-2ba1-48f9-8fd1-dfe83c11c4ce None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:01.993430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50534543-2ba1-48f9-8fd1-dfe83c11c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:01.993712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50534543-2ba1-48f9-8fd1-dfe83c11c4ce None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:01.994578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50534543-2ba1-48f9-8fd1-dfe83c11c4ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:01.994758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50534543-2ba1-48f9-8fd1-dfe83c11c4ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:01.996203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50534543-2ba1-48f9-8fd1-dfe83c11c4ce None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:02.013801 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 416/834] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:10:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:02.015654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50534543-2ba1-48f9-8fd1-dfe83c11c4ce None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:02.022088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14dabd-808b-4f13-b6b7-9631133e93c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:02.022709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14dabd-808b-4f13-b6b7-9631133e93c6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:02.022991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14dabd-808b-4f13-b6b7-9631133e93c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:02.023265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14dabd-808b-4f13-b6b7-9631133e93c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:02.023941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14dabd-808b-4f13-b6b7-9631133e93c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:02.024247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14dabd-808b-4f13-b6b7-9631133e93c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:02.025625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14dabd-808b-4f13-b6b7-9631133e93c6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:02.038103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 419/835] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:02.043390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14dabd-808b-4f13-b6b7-9631133e93c6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:02.083533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:02.154054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50534543-2ba1-48f9-8fd1-dfe83c11c4ce None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:02.181855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14dabd-808b-4f13-b6b7-9631133e93c6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:02.188351 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14f9e0-42e5-4045-b5e6-4bb8a7d8141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:02.189046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f9e0-42e5-4045-b5e6-4bb8a7d8141e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:02.189386 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f9e0-42e5-4045-b5e6-4bb8a7d8141e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:02.189719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f9e0-42e5-4045-b5e6-4bb8a7d8141e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:02.190650 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14f9e0-42e5-4045-b5e6-4bb8a7d8141e None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=a86ca59cbf894c508b3439b08715da86) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:02.191026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14f9e0-42e5-4045-b5e6-4bb8a7d8141e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:02.192627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14f9e0-42e5-4045-b5e6-4bb8a7d8141e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:02.199369 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 417/836] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:02 2022] GET /identity/v3/role_assignments?user.id=a86ca59cbf894c508b3439b08715da86&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:02.225517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab475944-001e-414e-b9f8-39ae255de50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:02.226207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab475944-001e-414e-b9f8-39ae255de50e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:02.226494 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab475944-001e-414e-b9f8-39ae255de50e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:02.226771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab475944-001e-414e-b9f8-39ae255de50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:02.240178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab475944-001e-414e-b9f8-39ae255de50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:02.241669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab475944-001e-414e-b9f8-39ae255de50e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ab475944-001e-414e-b9f8-39ae255de50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:02.258253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:02.259275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:02.261054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:02.261054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:02.261054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:02.264904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 420/837] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:02.266274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14f9e0-42e5-4045-b5e6-4bb8a7d8141e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:02.308205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:02.311036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f47f7-aec2-4bd0-8afb-86d42678660d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:02.311610 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f47f7-aec2-4bd0-8afb-86d42678660d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:02.311965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f47f7-aec2-4bd0-8afb-86d42678660d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:02.313936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 421/838] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:02.319616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe595198-9395-4806-877d-cbb3553e4bd3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:02.319892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe595198-9395-4806-877d-cbb3553e4bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:02.320168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe595198-9395-4806-877d-cbb3553e4bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:02.344865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fe595198-9395-4806-877d-cbb3553e4bd3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:02.346315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fe595198-9395-4806-877d-cbb3553e4bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:02.383947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14f9e0-42e5-4045-b5e6-4bb8a7d8141e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:02.428824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc893685-db5c-4694-93ed-5b68f605a54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:02.429438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893685-db5c-4694-93ed-5b68f605a54a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:02.429718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893685-db5c-4694-93ed-5b68f605a54a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:02.429998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc893685-db5c-4694-93ed-5b68f605a54a None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:02.430677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc893685-db5c-4694-93ed-5b68f605a54a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:02.430983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc893685-db5c-4694-93ed-5b68f605a54a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:02.432338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc893685-db5c-4694-93ed-5b68f605a54a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:02.438135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 422/839] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:02.446815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 418/840] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:02.452483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe595198-9395-4806-877d-cbb3553e4bd3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:02.467428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:02.567529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe595198-9395-4806-877d-cbb3553e4bd3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:02.603502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba89db-b80f-4f8c-a29d-8326882ca977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:02.604673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba89db-b80f-4f8c-a29d-8326882ca977 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:02.605133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba89db-b80f-4f8c-a29d-8326882ca977 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:02.606136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba89db-b80f-4f8c-a29d-8326882ca977 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:02.613605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba89db-b80f-4f8c-a29d-8326882ca977 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:02.615238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba89db-b80f-4f8c-a29d-8326882ca977 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-6eba89db-b80f-4f8c-a29d-8326882ca977 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:10:02.627103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:02.628307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:02.629441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:02.629441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:02.629441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:10:02.629441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:10:02.629441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:10:02.629441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:10:02.629441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:10:02.629441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:10:02.629441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 19 15:10:02.629441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:02.631577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 423/841] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:10:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:02.638214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc893685-db5c-4694-93ed-5b68f605a54a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:02.711430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba89db-b80f-4f8c-a29d-8326882ca977 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:02.729982 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:02.753524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc893685-db5c-4694-93ed-5b68f605a54a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:02.790539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af57a5-e8f8-4230-a598-e3657c11a607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:02.791312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af57a5-e8f8-4230-a598-e3657c11a607 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:02.791745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af57a5-e8f8-4230-a598-e3657c11a607 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:02.792119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af57a5-e8f8-4230-a598-e3657c11a607 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:02.793593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af57a5-e8f8-4230-a598-e3657c11a607 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:02.794089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af57a5-e8f8-4230-a598-e3657c11a607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:02.795733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af57a5-e8f8-4230-a598-e3657c11a607 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:02.798811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:02.818559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 419/842] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Aug 19 15:10:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:02.824331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af57a5-e8f8-4230-a598-e3657c11a607 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:02.835947 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba89db-b80f-4f8c-a29d-8326882ca977 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:02.884099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb23efb-f5ff-4242-9a84-7a8ae7952796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:02.884828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb23efb-f5ff-4242-9a84-7a8ae7952796 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:02.885172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb23efb-f5ff-4242-9a84-7a8ae7952796 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:02.885508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb23efb-f5ff-4242-9a84-7a8ae7952796 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:02.886188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb23efb-f5ff-4242-9a84-7a8ae7952796 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:02.887716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb23efb-f5ff-4242-9a84-7a8ae7952796 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0fb23efb-f5ff-4242-9a84-7a8ae7952796 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:02.900898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:02.902154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:10:02.903259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:02.904915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 424/843] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:10:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:02.911008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb23efb-f5ff-4242-9a84-7a8ae7952796 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:02.943309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af57a5-e8f8-4230-a598-e3657c11a607 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:02.979701 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa1517-0374-4732-b07f-d00082f43a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:02.981155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa1517-0374-4732-b07f-d00082f43a5b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:02.981628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa1517-0374-4732-b07f-d00082f43a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:02.982181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa1517-0374-4732-b07f-d00082f43a5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:02.991887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:03.050464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb23efb-f5ff-4242-9a84-7a8ae7952796 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:03.056026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa1517-0374-4732-b07f-d00082f43a5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:03.057695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa1517-0374-4732-b07f-d00082f43a5b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:03.096455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3647e-90e3-410f-93f6-febf8f6e6d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:03.097434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3647e-90e3-410f-93f6-febf8f6e6d34 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:03.097983 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3647e-90e3-410f-93f6-febf8f6e6d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:03.098497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3647e-90e3-410f-93f6-febf8f6e6d34 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:03.099722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3647e-90e3-410f-93f6-febf8f6e6d34 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:03.100262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3647e-90e3-410f-93f6-febf8f6e6d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:03.104539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3647e-90e3-410f-93f6-febf8f6e6d34 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:03.108584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:03.114575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 425/844] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:10:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:03.118721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3647e-90e3-410f-93f6-febf8f6e6d34 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:03.171164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 420/845] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:02 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:10:03.172424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9741ac-1937-4386-8534-a81ae10075a5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:03.172706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9741ac-1937-4386-8534-a81ae10075a5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:03.172981 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9741ac-1937-4386-8534-a81ae10075a5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:03.174389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 421/846] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:03.178812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9741ac-1937-4386-8534-a81ae10075a5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:03.221708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:03.224361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3647e-90e3-410f-93f6-febf8f6e6d34 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:03.261413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357c909-dd16-4c19-95c5-17dea4992e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:03.262212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357c909-dd16-4c19-95c5-17dea4992e26 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:03.262497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357c909-dd16-4c19-95c5-17dea4992e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:03.262769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357c909-dd16-4c19-95c5-17dea4992e26 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:03.263397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357c909-dd16-4c19-95c5-17dea4992e26 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:03.263702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357c909-dd16-4c19-95c5-17dea4992e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:03.265067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357c909-dd16-4c19-95c5-17dea4992e26 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:03.277063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 426/847] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:10:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:03.277063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fff2b-9780-4d3d-9a65-11db70460226 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:03.277063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fff2b-9780-4d3d-9a65-11db70460226 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:03.277063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fff2b-9780-4d3d-9a65-11db70460226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:03.296162 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-516fff2b-9780-4d3d-9a65-11db70460226 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:03.297009 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9741ac-1937-4386-8534-a81ae10075a5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:03.297583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-516fff2b-9780-4d3d-9a65-11db70460226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:03.343751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97011896-2a53-45d4-915f-d72685cb4da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:03.344396 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97011896-2a53-45d4-915f-d72685cb4da2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:03.344676 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97011896-2a53-45d4-915f-d72685cb4da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:03.344946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97011896-2a53-45d4-915f-d72685cb4da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:03.357221 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97011896-2a53-45d4-915f-d72685cb4da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:03.358712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97011896-2a53-45d4-915f-d72685cb4da2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-97011896-2a53-45d4-915f-d72685cb4da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:03.375362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:03.376383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:03.377679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:03.377679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:03.377679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:03.377679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 422/848] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:03.381418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:03.384170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97011896-2a53-45d4-915f-d72685cb4da2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:03.402629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 427/849] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:03.485648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:03.495011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97011896-2a53-45d4-915f-d72685cb4da2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:03.535410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c26b31-dcd3-4efc-b069-89d6ee195cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:03.536014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26b31-dcd3-4efc-b069-89d6ee195cec None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:03.536289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26b31-dcd3-4efc-b069-89d6ee195cec None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:03.536557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26b31-dcd3-4efc-b069-89d6ee195cec None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:03.537199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c26b31-dcd3-4efc-b069-89d6ee195cec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:03.537497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c26b31-dcd3-4efc-b069-89d6ee195cec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:03.538872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c26b31-dcd3-4efc-b069-89d6ee195cec None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:03.556169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 423/850] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:03.562159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fff2b-9780-4d3d-9a65-11db70460226 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:03.669031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fff2b-9780-4d3d-9a65-11db70460226 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:03.684223 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c26b31-dcd3-4efc-b069-89d6ee195cec None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:03.705326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32c5eb-6961-4499-82e1-56c2dd092533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:03.706360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32c5eb-6961-4499-82e1-56c2dd092533 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:03.706868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32c5eb-6961-4499-82e1-56c2dd092533 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:03.707357 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32c5eb-6961-4499-82e1-56c2dd092533 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:03.714662 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32c5eb-6961-4499-82e1-56c2dd092533 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:03.716252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32c5eb-6961-4499-82e1-56c2dd092533 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2f32c5eb-6961-4499-82e1-56c2dd092533 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:10:03.728426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:03.729708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:03.734263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:10:03.734263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:10:03.734263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:10:03.734263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:10:03.734263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:10:03.734263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:10:03.734263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:03.734263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:03.734263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 428/851] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:03.738821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32c5eb-6961-4499-82e1-56c2dd092533 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:03.806606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:03.810443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c26b31-dcd3-4efc-b069-89d6ee195cec None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:03.858594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85546754-f580-419a-813c-2d849fe90a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:03.859380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546754-f580-419a-813c-2d849fe90a8e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:03.859759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546754-f580-419a-813c-2d849fe90a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:03.860035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85546754-f580-419a-813c-2d849fe90a8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:03.869310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32c5eb-6961-4499-82e1-56c2dd092533 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:03.873859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85546754-f580-419a-813c-2d849fe90a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-85546754-f580-419a-813c-2d849fe90a8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:03.879698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:03.880631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:03.886705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 424/852] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:10:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:03.888861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85546754-f580-419a-813c-2d849fe90a8e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:03.901592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:03.910968 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523183-c362-4dae-9735-aadd4f40a745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:03.911584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523183-c362-4dae-9735-aadd4f40a745 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:03.911865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523183-c362-4dae-9735-aadd4f40a745 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:03.912135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a523183-c362-4dae-9735-aadd4f40a745 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:03.912832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a523183-c362-4dae-9735-aadd4f40a745 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:03.913304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a523183-c362-4dae-9735-aadd4f40a745 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:03.915594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a523183-c362-4dae-9735-aadd4f40a745 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:03.934224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 429/853] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:03.939500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523183-c362-4dae-9735-aadd4f40a745 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:04.017904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85546754-f580-419a-813c-2d849fe90a8e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:04.054694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a523183-c362-4dae-9735-aadd4f40a745 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:04.056515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604f856-d0ae-4e75-877b-8245136b84cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:04.057432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604f856-d0ae-4e75-877b-8245136b84cc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:04.057945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604f856-d0ae-4e75-877b-8245136b84cc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:04.058480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604f856-d0ae-4e75-877b-8245136b84cc None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:04.059452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604f856-d0ae-4e75-877b-8245136b84cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:04.060014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604f856-d0ae-4e75-877b-8245136b84cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:04.061615 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604f856-d0ae-4e75-877b-8245136b84cc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:04.069475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:04.076896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 425/854] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:10:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:04.078578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604f856-d0ae-4e75-877b-8245136b84cc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:04.091918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c450393-a233-4789-aa01-fda7a3429392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:04.092525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c450393-a233-4789-aa01-fda7a3429392 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:04.092805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c450393-a233-4789-aa01-fda7a3429392 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:04.093361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c450393-a233-4789-aa01-fda7a3429392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:04.093792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c450393-a233-4789-aa01-fda7a3429392 None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=62c25756d0814f1dbb8ca210ae34c892) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:04.094140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c450393-a233-4789-aa01-fda7a3429392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:04.095572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c450393-a233-4789-aa01-fda7a3429392 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:04.110053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 430/855] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:03 2022] GET /identity/v3/role_assignments?user.id=62c25756d0814f1dbb8ca210ae34c892&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:04.170583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:04.204110 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604f856-d0ae-4e75-877b-8245136b84cc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:04.245381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a96138-010c-4a3f-ac3c-caed9386b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:04.246478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a96138-010c-4a3f-ac3c-caed9386b263 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:04.246970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a96138-010c-4a3f-ac3c-caed9386b263 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:04.247477 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a96138-010c-4a3f-ac3c-caed9386b263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:04.260115 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a96138-010c-4a3f-ac3c-caed9386b263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:04.262577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a96138-010c-4a3f-ac3c-caed9386b263 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e7a96138-010c-4a3f-ac3c-caed9386b263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:04.279058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:04.280046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:04.280947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:04.280947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:04.280947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:04.287569 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 426/856] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:04.289137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c450393-a233-4789-aa01-fda7a3429392 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:04.302391 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa288cb3-050f-4df2-ab65-0f1cd1b89c51 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:04.302677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa288cb3-050f-4df2-ab65-0f1cd1b89c51 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:04.302950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa288cb3-050f-4df2-ab65-0f1cd1b89c51 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:04.304533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 427/857] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:10:04.309526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7471c-4205-4075-b039-7351990e9b9c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:04.309811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7471c-4205-4075-b039-7351990e9b9c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:04.310120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7471c-4205-4075-b039-7351990e9b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:04.330213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-96d7471c-4205-4075-b039-7351990e9b9c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:04.331421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-96d7471c-4205-4075-b039-7351990e9b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:04.405593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 428/858] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:04.418904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c450393-a233-4789-aa01-fda7a3429392 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:04.453731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60666fdc-49c6-4532-bb92-6243f9b4ea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:04.454782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60666fdc-49c6-4532-bb92-6243f9b4ea2b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:04.455242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60666fdc-49c6-4532-bb92-6243f9b4ea2b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:04.455737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60666fdc-49c6-4532-bb92-6243f9b4ea2b None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:04.456559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60666fdc-49c6-4532-bb92-6243f9b4ea2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:04.457066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60666fdc-49c6-4532-bb92-6243f9b4ea2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:04.458635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60666fdc-49c6-4532-bb92-6243f9b4ea2b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:04.470951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 431/859] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:04.478057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7471c-4205-4075-b039-7351990e9b9c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:04.543601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:04.591632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7471c-4205-4075-b039-7351990e9b9c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:04.627706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bbe05-2946-43e8-9e48-f3c64d82a5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:04.628346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bbe05-2946-43e8-9e48-f3c64d82a5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:04.628627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bbe05-2946-43e8-9e48-f3c64d82a5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:04.628945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bbe05-2946-43e8-9e48-f3c64d82a5b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:04.636499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bbe05-2946-43e8-9e48-f3c64d82a5b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:04.637948 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bbe05-2946-43e8-9e48-f3c64d82a5b9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-151bbe05-2946-43e8-9e48-f3c64d82a5b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:10:04.650592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:04.651566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:04.653048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:04.653048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:04.653048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:10:04.653048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:10:04.653048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:10:04.653048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:10:04.653048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:10:04.653048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:10:04.653048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:10:04.653048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:04.653048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 429/860] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 19 15:10:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:04.658099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60666fdc-49c6-4532-bb92-6243f9b4ea2b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:04.688918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bbe05-2946-43e8-9e48-f3c64d82a5b9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:04.703885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:04.788006 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60666fdc-49c6-4532-bb92-6243f9b4ea2b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:04.803512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bbe05-2946-43e8-9e48-f3c64d82a5b9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:04.818588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:04.836105 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc8bd5-1c21-4556-90d4-2894d5839bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:04.837283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8bd5-1c21-4556-90d4-2894d5839bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:04.838056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8bd5-1c21-4556-90d4-2894d5839bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:04.838971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8bd5-1c21-4556-90d4-2894d5839bb1 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:04.840749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc8bd5-1c21-4556-90d4-2894d5839bb1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:04.841266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc8bd5-1c21-4556-90d4-2894d5839bb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:04.843026 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc8bd5-1c21-4556-90d4-2894d5839bb1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:04.844085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad666b10-15db-44dd-940a-376f6a6d3a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:04.844727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad666b10-15db-44dd-940a-376f6a6d3a96 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:04.845008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad666b10-15db-44dd-940a-376f6a6d3a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:04.845283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad666b10-15db-44dd-940a-376f6a6d3a96 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:04.845881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad666b10-15db-44dd-940a-376f6a6d3a96 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:04.847752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad666b10-15db-44dd-940a-376f6a6d3a96 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ad666b10-15db-44dd-940a-376f6a6d3a96 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:04.857379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:04.858368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:10:04.859252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:04.863517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 430/861] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Aug 19 15:10:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:04.864354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad666b10-15db-44dd-940a-376f6a6d3a96 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:04.869789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 432/862] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 19 15:10:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:04.879012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc8bd5-1c21-4556-90d4-2894d5839bb1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:04.977576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad666b10-15db-44dd-940a-376f6a6d3a96 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:05.010382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:05.013323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7ee41-711d-434c-abed-7eb205a3a6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:05.014044 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7ee41-711d-434c-abed-7eb205a3a6de None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:05.014340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7ee41-711d-434c-abed-7eb205a3a6de None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:05.014618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7ee41-711d-434c-abed-7eb205a3a6de None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:05.015937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7ee41-711d-434c-abed-7eb205a3a6de None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:05.016260 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7ee41-711d-434c-abed-7eb205a3a6de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:05.017827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7ee41-711d-434c-abed-7eb205a3a6de None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:05.020172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc8bd5-1c21-4556-90d4-2894d5839bb1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:05.027156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 431/863] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 19 15:10:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:05.034278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7ee41-711d-434c-abed-7eb205a3a6de None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:05.063813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a39ec6-b823-40e2-a8e0-8b08023a8334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:05.064659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a39ec6-b823-40e2-a8e0-8b08023a8334 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:05.065131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a39ec6-b823-40e2-a8e0-8b08023a8334 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:05.065605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a39ec6-b823-40e2-a8e0-8b08023a8334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:05.079715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:05.139511 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7ee41-711d-434c-abed-7eb205a3a6de None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:05.145000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a39ec6-b823-40e2-a8e0-8b08023a8334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:05.146697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a39ec6-b823-40e2-a8e0-8b08023a8334 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:05.175065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58365c24-06fb-44d4-a065-f955f7577ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:05.175964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58365c24-06fb-44d4-a065-f955f7577ffe None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:05.176077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58365c24-06fb-44d4-a065-f955f7577ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:05.176382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58365c24-06fb-44d4-a065-f955f7577ffe None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:05.177090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58365c24-06fb-44d4-a065-f955f7577ffe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:05.177515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58365c24-06fb-44d4-a065-f955f7577ffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:05.179059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58365c24-06fb-44d4-a065-f955f7577ffe None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:05.190256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 432/864] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 19 15:10:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:05.261038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:05.273918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 433/865] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:10:05.278332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f76b7-0826-41ee-8bb3-fe5ad3b5bf0c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:05.278814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f76b7-0826-41ee-8bb3-fe5ad3b5bf0c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:05.278894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f76b7-0826-41ee-8bb3-fe5ad3b5bf0c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:05.280329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a39ec6-b823-40e2-a8e0-8b08023a8334 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:05.280448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 433/866] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:05.290130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bef5f7-feb1-4c10-9e26-fd7f2d7109a3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:05.290130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bef5f7-feb1-4c10-9e26-fd7f2d7109a3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:05.290130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bef5f7-feb1-4c10-9e26-fd7f2d7109a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:05.310597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-97bef5f7-feb1-4c10-9e26-fd7f2d7109a3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:05.311839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-97bef5f7-feb1-4c10-9e26-fd7f2d7109a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:05.395630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 434/867] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:05.398194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a39ec6-b823-40e2-a8e0-8b08023a8334 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:05.433410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffea92-5447-49b2-b591-019fbb499f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:05.434801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffea92-5447-49b2-b591-019fbb499f86 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:05.435230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffea92-5447-49b2-b591-019fbb499f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:05.435644 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffea92-5447-49b2-b591-019fbb499f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:05.446400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffea92-5447-49b2-b591-019fbb499f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:05.448066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffea92-5447-49b2-b591-019fbb499f86 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4bffea92-5447-49b2-b591-019fbb499f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:05.463584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:05.464779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:05.465852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:05.465852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:05.465852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:05.467542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 434/868] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:05.475271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bef5f7-feb1-4c10-9e26-fd7f2d7109a3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:05.508389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:05.576694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bef5f7-feb1-4c10-9e26-fd7f2d7109a3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:05.612402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c4d27-fb06-4018-8f9a-d05409f3ec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:05.613068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c4d27-fb06-4018-8f9a-d05409f3ec4e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:05.613350 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c4d27-fb06-4018-8f9a-d05409f3ec4e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:05.613625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c4d27-fb06-4018-8f9a-d05409f3ec4e None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:05.614389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c4d27-fb06-4018-8f9a-d05409f3ec4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:05.614700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c4d27-fb06-4018-8f9a-d05409f3ec4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:05.616107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c4d27-fb06-4018-8f9a-d05409f3ec4e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:05.632212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 435/869] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:05.639122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffea92-5447-49b2-b591-019fbb499f86 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:05.686081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c4d27-fb06-4018-8f9a-d05409f3ec4e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:05.691625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:05.746425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffea92-5447-49b2-b591-019fbb499f86 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:05.782047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8c61e-0e9e-4d11-8f28-ad217563579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:05.782690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8c61e-0e9e-4d11-8f28-ad217563579e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:05.782970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8c61e-0e9e-4d11-8f28-ad217563579e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:05.783240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8c61e-0e9e-4d11-8f28-ad217563579e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:05.790168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8c61e-0e9e-4d11-8f28-ad217563579e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:05.791626 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8c61e-0e9e-4d11-8f28-ad217563579e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:05.793910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:05.801723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c4d27-fb06-4018-8f9a-d05409f3ec4e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1df8c61e-0e9e-4d11-8f28-ad217563579e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:10:05.803075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:05.803980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:05.804856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:10:05.804856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:10:05.804856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:10:05.804856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:10:05.804856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:10:05.804856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:10:05.804856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:05.804856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:05.804856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 435/870] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:05.811097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8c61e-0e9e-4d11-8f28-ad217563579e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:05.849553 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361391f-d219-40cc-903c-8773c2dfdcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:05.850657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361391f-d219-40cc-903c-8773c2dfdcd4 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:05.851095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361391f-d219-40cc-903c-8773c2dfdcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:05.851538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361391f-d219-40cc-903c-8773c2dfdcd4 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:05.852338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361391f-d219-40cc-903c-8773c2dfdcd4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:05.854308 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361391f-d219-40cc-903c-8773c2dfdcd4 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:05.880950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 436/871] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:10:05 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:10:05.939299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8c61e-0e9e-4d11-8f28-ad217563579e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:05.950985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:05.986901 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbcc98-1597-4827-b11b-68928016d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:05.987970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbcc98-1597-4827-b11b-68928016d010 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:05.988500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbcc98-1597-4827-b11b-68928016d010 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:05.988980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbcc98-1597-4827-b11b-68928016d010 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:05.989898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbcc98-1597-4827-b11b-68928016d010 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:05.990477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbcc98-1597-4827-b11b-68928016d010 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:05.992267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbcc98-1597-4827-b11b-68928016d010 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:06.006756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 436/872] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:10:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:06.013205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361391f-d219-40cc-903c-8773c2dfdcd4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:06.121880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361391f-d219-40cc-903c-8773c2dfdcd4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:06.145347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784395ca-9bf0-4671-bfff-3c1c477d0a15 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:06.145691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784395ca-9bf0-4671-bfff-3c1c477d0a15 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:06.145897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784395ca-9bf0-4671-bfff-3c1c477d0a15 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:06.147544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 437/873] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:10:06.152579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea318c5-42d8-479e-a338-fc801f42d5ee None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:06.152864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea318c5-42d8-479e-a338-fc801f42d5ee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:06.153143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea318c5-42d8-479e-a338-fc801f42d5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:06.160692 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182495-7259-42c2-91bc-c7fabdfeba78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:06.161570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182495-7259-42c2-91bc-c7fabdfeba78 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:06.162106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182495-7259-42c2-91bc-c7fabdfeba78 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:06.162575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e182495-7259-42c2-91bc-c7fabdfeba78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:06.163511 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e182495-7259-42c2-91bc-c7fabdfeba78 None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=8e2cfbdc26484ae68545115f9751d482) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:06.164018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e182495-7259-42c2-91bc-c7fabdfeba78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:06.165617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e182495-7259-42c2-91bc-c7fabdfeba78 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:06.171533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3ea318c5-42d8-479e-a338-fc801f42d5ee None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:06.172442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 437/874] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:06 2022] GET /identity/v3/role_assignments?user.id=8e2cfbdc26484ae68545115f9751d482&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:06.172739 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ea318c5-42d8-479e-a338-fc801f42d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:06.253241 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 438/875] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:06.525319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182495-7259-42c2-91bc-c7fabdfeba78 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:06.545751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:06.629629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e182495-7259-42c2-91bc-c7fabdfeba78 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:06.664676 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872ebbd-0026-4157-9387-6dec59366362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:06.665302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ebbd-0026-4157-9387-6dec59366362 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:06.665575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ebbd-0026-4157-9387-6dec59366362 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:06.665840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872ebbd-0026-4157-9387-6dec59366362 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:06.666501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872ebbd-0026-4157-9387-6dec59366362 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:06.668384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872ebbd-0026-4157-9387-6dec59366362 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f872ebbd-0026-4157-9387-6dec59366362 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:06.681235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:06.682276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:06.683122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 438/876] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 19 15:10:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:06.688879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea318c5-42d8-479e-a338-fc801f42d5ee None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:06.789334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:06.799322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea318c5-42d8-479e-a338-fc801f42d5ee None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:06.835916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62972290-fecc-4695-8053-3d3a1a66411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:06.836905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972290-fecc-4695-8053-3d3a1a66411f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:06.837394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972290-fecc-4695-8053-3d3a1a66411f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:06.837875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972290-fecc-4695-8053-3d3a1a66411f None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:06.838734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62972290-fecc-4695-8053-3d3a1a66411f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:06.839244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62972290-fecc-4695-8053-3d3a1a66411f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:06.841357 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62972290-fecc-4695-8053-3d3a1a66411f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:06.846810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 439/877] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 19 15:10:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:06.852235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872ebbd-0026-4157-9387-6dec59366362 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:06.941853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:06.958470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872ebbd-0026-4157-9387-6dec59366362 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:06.994215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a273c63-715c-4ae4-9b33-03d237f081b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:06.994821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273c63-715c-4ae4-9b33-03d237f081b1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:06.995098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273c63-715c-4ae4-9b33-03d237f081b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:06.995368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273c63-715c-4ae4-9b33-03d237f081b1 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:06.996021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a273c63-715c-4ae4-9b33-03d237f081b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:06.996323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a273c63-715c-4ae4-9b33-03d237f081b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:06.997675 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a273c63-715c-4ae4-9b33-03d237f081b1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:07.002599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 439/878] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 19 15:10:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:07.249876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454888-eebb-4a5c-8b66-4fb41c68f3f7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:07.250209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454888-eebb-4a5c-8b66-4fb41c68f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:07.250487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454888-eebb-4a5c-8b66-4fb41c68f3f7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:07.252112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 440/879] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:07.257382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2fb05-a5de-47a8-aa02-025b25fd5f25 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:07.257672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2fb05-a5de-47a8-aa02-025b25fd5f25 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:07.257953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2fb05-a5de-47a8-aa02-025b25fd5f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:07.276595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b3e2fb05-a5de-47a8-aa02-025b25fd5f25 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:07.278371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b3e2fb05-a5de-47a8-aa02-025b25fd5f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:07.353596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 440/880] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:07.626333 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8454888-eebb-4a5c-8b66-4fb41c68f3f7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:07.734791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8454888-eebb-4a5c-8b66-4fb41c68f3f7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:07.774689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df04d7-1038-408e-92cf-442875c3e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:07.775296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df04d7-1038-408e-92cf-442875c3e1dd None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:07.775575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df04d7-1038-408e-92cf-442875c3e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:07.775851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df04d7-1038-408e-92cf-442875c3e1dd None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:07.776497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df04d7-1038-408e-92cf-442875c3e1dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:07.778394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df04d7-1038-408e-92cf-442875c3e1dd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:07.797411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 441/881] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:10:07 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:10:07.914956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084897-48bf-498a-a88b-a106e2f232b0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:07.915872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084897-48bf-498a-a88b-a106e2f232b0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:07.916336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81084897-48bf-498a-a88b-a106e2f232b0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:07.918818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 441/882] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:07.924669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7078b8-170a-479a-a13a-f9cdd5562857 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:07.925268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7078b8-170a-479a-a13a-f9cdd5562857 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:07.925768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7078b8-170a-479a-a13a-f9cdd5562857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:07.948576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1d7078b8-170a-479a-a13a-f9cdd5562857 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:07.950347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1d7078b8-170a-479a-a13a-f9cdd5562857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:07.964452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:08.030942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 442/883] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:08.227784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8642-2fa1-4ee0-8791-255ad480820f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:08.228192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8642-2fa1-4ee0-8791-255ad480820f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:08.228576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8642-2fa1-4ee0-8791-255ad480820f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:08.231060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 442/884] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:08.236242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcd104-aef1-46d9-8489-d3b2af6c4983 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:08.236634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcd104-aef1-46d9-8489-d3b2af6c4983 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:08.237006 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcd104-aef1-46d9-8489-d3b2af6c4983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:08.255779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-55fcd104-aef1-46d9-8489-d3b2af6c4983 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:08.256962 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-55fcd104-aef1-46d9-8489-d3b2af6c4983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:08.302995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8642-2fa1-4ee0-8791-255ad480820f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:08.338582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 443/885] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:08.395398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:08.419806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8642-2fa1-4ee0-8791-255ad480820f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:08.459869 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb11427-05fc-4ff1-a555-d02245f9bbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:08.460495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb11427-05fc-4ff1-a555-d02245f9bbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:08.460765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb11427-05fc-4ff1-a555-d02245f9bbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:08.461032 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb11427-05fc-4ff1-a555-d02245f9bbf9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:08.461611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb11427-05fc-4ff1-a555-d02245f9bbf9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:08.463065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb11427-05fc-4ff1-a555-d02245f9bbf9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4bb11427-05fc-4ff1-a555-d02245f9bbf9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:08.472606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:08.473565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:08.474443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 443/886] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:10:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:08.482415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcd104-aef1-46d9-8489-d3b2af6c4983 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:08.565080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:08.591169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcd104-aef1-46d9-8489-d3b2af6c4983 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:08.626117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590303e-ef8d-497f-869b-c3afd6fcb8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:08.626735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590303e-ef8d-497f-869b-c3afd6fcb8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:08.627017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590303e-ef8d-497f-869b-c3afd6fcb8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:08.627294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590303e-ef8d-497f-869b-c3afd6fcb8a9 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:08.627928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590303e-ef8d-497f-869b-c3afd6fcb8a9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:08.628233 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590303e-ef8d-497f-869b-c3afd6fcb8a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:08.629603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590303e-ef8d-497f-869b-c3afd6fcb8a9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:08.634626 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 444/887] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:10:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:08.640076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb11427-05fc-4ff1-a555-d02245f9bbf9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:08.643250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590303e-ef8d-497f-869b-c3afd6fcb8a9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:08.754767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb11427-05fc-4ff1-a555-d02245f9bbf9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:08.764260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590303e-ef8d-497f-869b-c3afd6fcb8a9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:08.792144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacdee6-47b6-41de-8440-bcd71bf06a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:08.793076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacdee6-47b6-41de-8440-bcd71bf06a4f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:08.793657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacdee6-47b6-41de-8440-bcd71bf06a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:08.794449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacdee6-47b6-41de-8440-bcd71bf06a4f None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:08.795516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacdee6-47b6-41de-8440-bcd71bf06a4f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:08.796119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacdee6-47b6-41de-8440-bcd71bf06a4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:08.797848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacdee6-47b6-41de-8440-bcd71bf06a4f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:08.798905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd72571-6286-4803-91ba-2c001fca3b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:08.799544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd72571-6286-4803-91ba-2c001fca3b3d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:08.799832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd72571-6286-4803-91ba-2c001fca3b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:08.800113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd72571-6286-4803-91ba-2c001fca3b3d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:08.805252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 444/888] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:10:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:08.810689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacdee6-47b6-41de-8440-bcd71bf06a4f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:08.812324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd72571-6286-4803-91ba-2c001fca3b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1dd72571-6286-4803-91ba-2c001fca3b3d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:08.818747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:08.819699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:08.820551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:08.821187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:08.828680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:08.828924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 445/889] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 19 15:10:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:08.830125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd72571-6286-4803-91ba-2c001fca3b3d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:08.926290 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacdee6-47b6-41de-8440-bcd71bf06a4f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:08.960097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd72571-6286-4803-91ba-2c001fca3b3d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:08.965417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d818259-5d90-47f1-a225-3b49db1fcb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:08.966020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d818259-5d90-47f1-a225-3b49db1fcb36 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:08.966321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d818259-5d90-47f1-a225-3b49db1fcb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:08.966589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d818259-5d90-47f1-a225-3b49db1fcb36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:08.967282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d818259-5d90-47f1-a225-3b49db1fcb36 None admin] RBAC: Adding query filter params (interface=public, service_id=98a74cfb89444046b45ee0e6ffcdc99f, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:08.967584 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d818259-5d90-47f1-a225-3b49db1fcb36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:08.968929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d818259-5d90-47f1-a225-3b49db1fcb36 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:08.978464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 445/890] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 19 15:10:08 2022] GET /identity/v3/endpoints?service_id=98a74cfb89444046b45ee0e6ffcdc99f&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:08.978464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b265-b7f8-4873-a0c3-3d48a25ee16e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:08.978464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b265-b7f8-4873-a0c3-3d48a25ee16e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:08.978464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645b265-b7f8-4873-a0c3-3d48a25ee16e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:08.978464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 446/891] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:08.982955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645b265-b7f8-4873-a0c3-3d48a25ee16e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:09.004308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a57d7-b588-42bf-9eb4-10b6fc6c6baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:09.005083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a57d7-b588-42bf-9eb4-10b6fc6c6baa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:09.005302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a57d7-b588-42bf-9eb4-10b6fc6c6baa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:09.005574 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a57d7-b588-42bf-9eb4-10b6fc6c6baa None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:09.006271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a57d7-b588-42bf-9eb4-10b6fc6c6baa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:09.006573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a57d7-b588-42bf-9eb4-10b6fc6c6baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:09.008164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a57d7-b588-42bf-9eb4-10b6fc6c6baa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:09.022332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 446/892] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 19 15:10:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:09.023429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f901f4-dce6-4343-ab58-ef43f7df32ec None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:09.023712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f901f4-dce6-4343-ab58-ef43f7df32ec None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:09.023986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f901f4-dce6-4343-ab58-ef43f7df32ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:09.042378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-49f901f4-dce6-4343-ab58-ef43f7df32ec None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:09.043811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-49f901f4-dce6-4343-ab58-ef43f7df32ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:09.054894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:09.089102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645b265-b7f8-4873-a0c3-3d48a25ee16e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:09.102727 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:09.114721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 447/893] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:09.115325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f901f4-dce6-4343-ab58-ef43f7df32ec None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:09.136125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576943-87a4-4c64-be01-9297c5290fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:09.137674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576943-87a4-4c64-be01-9297c5290fac None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:09.138192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576943-87a4-4c64-be01-9297c5290fac None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:09.139153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576943-87a4-4c64-be01-9297c5290fac None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:09.139984 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c576943-87a4-4c64-be01-9297c5290fac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:09.142051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c576943-87a4-4c64-be01-9297c5290fac None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:09.151058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 447/894] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 19 15:10:08 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:10:09.233415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f901f4-dce6-4343-ab58-ef43f7df32ec None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:09.272540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c412b-aee4-4d40-a93a-26688992f279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:09.273105 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c412b-aee4-4d40-a93a-26688992f279 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:09.273389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c412b-aee4-4d40-a93a-26688992f279 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:09.273661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c412b-aee4-4d40-a93a-26688992f279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:09.285245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c412b-aee4-4d40-a93a-26688992f279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:09.286793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c412b-aee4-4d40-a93a-26688992f279 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-002c412b-aee4-4d40-a93a-26688992f279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:09.302002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:09.302933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:09.303801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:09.303801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:09.303801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:09.303801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 448/895] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:09.310367 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576943-87a4-4c64-be01-9297c5290fac None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:09.395898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c412b-aee4-4d40-a93a-26688992f279 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:09.418935 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576943-87a4-4c64-be01-9297c5290fac None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:09.457985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:09.459218 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34ec49-4631-4fd9-a7c9-34aa73fd3e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:09.459911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34ec49-4631-4fd9-a7c9-34aa73fd3e3e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:09.460115 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34ec49-4631-4fd9-a7c9-34aa73fd3e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:09.460375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34ec49-4631-4fd9-a7c9-34aa73fd3e3e None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:09.461019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34ec49-4631-4fd9-a7c9-34aa73fd3e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:09.461320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34ec49-4631-4fd9-a7c9-34aa73fd3e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:09.462913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34ec49-4631-4fd9-a7c9-34aa73fd3e3e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:09.464634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:09.477630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 448/896] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:09.484085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34ec49-4631-4fd9-a7c9-34aa73fd3e3e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:09.536194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c412b-aee4-4d40-a93a-26688992f279 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:09.577762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccabed-152e-412b-b0d1-e4d3a46b5d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:09.578699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccabed-152e-412b-b0d1-e4d3a46b5d56 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:09.579124 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccabed-152e-412b-b0d1-e4d3a46b5d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:09.579684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccabed-152e-412b-b0d1-e4d3a46b5d56 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:09.580653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccabed-152e-412b-b0d1-e4d3a46b5d56 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:09.582300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edccabed-152e-412b-b0d1-e4d3a46b5d56 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:09.606540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 449/897] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:10:09 2022] POST /identity/v3/services => generated 241 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:10:09.627070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34ec49-4631-4fd9-a7c9-34aa73fd3e3e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:09.677218 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae81a2-739c-490a-aa28-8261cd7ba7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:09.678196 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae81a2-739c-490a-aa28-8261cd7ba7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:09.678617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae81a2-739c-490a-aa28-8261cd7ba7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:09.679061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae81a2-739c-490a-aa28-8261cd7ba7e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:09.688531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae81a2-739c-490a-aa28-8261cd7ba7e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:09.690251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae81a2-739c-490a-aa28-8261cd7ba7e6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-22ae81a2-739c-490a-aa28-8261cd7ba7e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:10:09.703322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:09.704499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:09.705637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:09.705637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:09.705637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:10:09.705637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:10:09.705637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:10:09.705637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:10:09.705637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:10:09.705637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:10:09.705637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:10:09.705637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:09.708023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 449/898] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 19 15:10:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:09.715406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccabed-152e-412b-b0d1-e4d3a46b5d56 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:09.827689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccabed-152e-412b-b0d1-e4d3a46b5d56 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:09.830019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:09.833311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d57e-c840-4cef-a47d-8e983cfd4e0e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:09.833603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d57e-c840-4cef-a47d-8e983cfd4e0e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:09.833886 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d57e-c840-4cef-a47d-8e983cfd4e0e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:09.835545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 450/899] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:09.841271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25d303-50e4-45d3-9fc0-b86593b6bfe0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:09.841557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25d303-50e4-45d3-9fc0-b86593b6bfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:09.841836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25d303-50e4-45d3-9fc0-b86593b6bfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:09.862411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6f25d303-50e4-45d3-9fc0-b86593b6bfe0 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:09.863720 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6f25d303-50e4-45d3-9fc0-b86593b6bfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:09.868145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b556e9-d22e-4e93-8f98-46a1811c2843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:09.868934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b556e9-d22e-4e93-8f98-46a1811c2843 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:09.869384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b556e9-d22e-4e93-8f98-46a1811c2843 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:09.869801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b556e9-d22e-4e93-8f98-46a1811c2843 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:09.870714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b556e9-d22e-4e93-8f98-46a1811c2843 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:09.871196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b556e9-d22e-4e93-8f98-46a1811c2843 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:09.872757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b556e9-d22e-4e93-8f98-46a1811c2843 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:09.890952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 450/900] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 19 15:10:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:09.896699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b556e9-d22e-4e93-8f98-46a1811c2843 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:09.917328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:09.941120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 451/901] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:10.000098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b556e9-d22e-4e93-8f98-46a1811c2843 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:10.034982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1d0b-0b6b-4655-a813-77a12d5d036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:10.035589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1d0b-0b6b-4655-a813-77a12d5d036b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:10.035865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1d0b-0b6b-4655-a813-77a12d5d036b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:10.036131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a1d0b-0b6b-4655-a813-77a12d5d036b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:10.064615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:10.106279 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a1d0b-0b6b-4655-a813-77a12d5d036b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:10.107660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a1d0b-0b6b-4655-a813-77a12d5d036b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:10.207770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 451/902] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:09 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 15:10:10.213299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25d303-50e4-45d3-9fc0-b86593b6bfe0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:10.227584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1d0b-0b6b-4655-a813-77a12d5d036b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:10.306425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:10.344377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25d303-50e4-45d3-9fc0-b86593b6bfe0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:10.356668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a1d0b-0b6b-4655-a813-77a12d5d036b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:10.382716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24281f56-8d05-4bce-82c0-21e78dc0675f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:10.383645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24281f56-8d05-4bce-82c0-21e78dc0675f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:10.384131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24281f56-8d05-4bce-82c0-21e78dc0675f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:10.384707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24281f56-8d05-4bce-82c0-21e78dc0675f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:10.390722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a93620-9de6-477c-b15c-a8cfd994258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:10.391342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a93620-9de6-477c-b15c-a8cfd994258c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:10.391622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a93620-9de6-477c-b15c-a8cfd994258c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:10.391892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a93620-9de6-477c-b15c-a8cfd994258c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:10.392474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a93620-9de6-477c-b15c-a8cfd994258c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:10.393938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a93620-9de6-477c-b15c-a8cfd994258c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:10.397818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24281f56-8d05-4bce-82c0-21e78dc0675f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:10.399477 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24281f56-8d05-4bce-82c0-21e78dc0675f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-93a93620-9de6-477c-b15c-a8cfd994258c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:10.403140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:10.404079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:10.409902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 452/903] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Aug 19 15:10:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:10.411580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a93620-9de6-477c-b15c-a8cfd994258c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-24281f56-8d05-4bce-82c0-21e78dc0675f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:10.420347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:10.421344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:10.422669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:10.422669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:10.422669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:10.426132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 452/904] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:10.427161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24281f56-8d05-4bce-82c0-21e78dc0675f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:10.469179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:10.560510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a93620-9de6-477c-b15c-a8cfd994258c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:10.569025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24281f56-8d05-4bce-82c0-21e78dc0675f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:10.591678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:10.604301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51ecf9-cb8e-4b24-a404-e538a8acb6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:10.605811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51ecf9-cb8e-4b24-a404-e538a8acb6fe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:10.606110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51ecf9-cb8e-4b24-a404-e538a8acb6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:10.606393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51ecf9-cb8e-4b24-a404-e538a8acb6fe None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:10.607366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51ecf9-cb8e-4b24-a404-e538a8acb6fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:10.607628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51ecf9-cb8e-4b24-a404-e538a8acb6fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:10.609240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51ecf9-cb8e-4b24-a404-e538a8acb6fe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:10.614813 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117129ca-1b09-4622-90fe-68efafbf7018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:10.615736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117129ca-1b09-4622-90fe-68efafbf7018 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:10.616215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117129ca-1b09-4622-90fe-68efafbf7018 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:10.616685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117129ca-1b09-4622-90fe-68efafbf7018 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:10.617516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117129ca-1b09-4622-90fe-68efafbf7018 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:10.618131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117129ca-1b09-4622-90fe-68efafbf7018 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:10.619906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117129ca-1b09-4622-90fe-68efafbf7018 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:10.620014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 453/905] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 19 15:10:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:10.620837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51ecf9-cb8e-4b24-a404-e538a8acb6fe None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:10.640411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 453/906] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:10.641741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117129ca-1b09-4622-90fe-68efafbf7018 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:10.735551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51ecf9-cb8e-4b24-a404-e538a8acb6fe None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:10.741841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:10.758884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117129ca-1b09-4622-90fe-68efafbf7018 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:10.782379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace769c-dc25-404f-897a-8e10e8989a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:10.783507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace769c-dc25-404f-897a-8e10e8989a3b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:10.783971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace769c-dc25-404f-897a-8e10e8989a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:10.784809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace769c-dc25-404f-897a-8e10e8989a3b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:10.785865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace769c-dc25-404f-897a-8e10e8989a3b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:10.786340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace769c-dc25-404f-897a-8e10e8989a3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:10.788779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace769c-dc25-404f-897a-8e10e8989a3b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:10.795832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 454/907] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 19 15:10:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:10.800900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6d5dd-40c4-4e11-83d2-dfe93f634ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:10.801311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace769c-dc25-404f-897a-8e10e8989a3b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:10.801728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6d5dd-40c4-4e11-83d2-dfe93f634ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:10.802103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6d5dd-40c4-4e11-83d2-dfe93f634ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:10.802436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6d5dd-40c4-4e11-83d2-dfe93f634ef0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:10.809753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6d5dd-40c4-4e11-83d2-dfe93f634ef0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:10.811292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6d5dd-40c4-4e11-83d2-dfe93f634ef0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-12a6d5dd-40c4-4e11-83d2-dfe93f634ef0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:10:10.823468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:10.824395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:10.825695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:10:10.825695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:10:10.825695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:10:10.825695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:10:10.825695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:10:10.825695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:10:10.825695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:10.825695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:10.825695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 454/908] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:10.830174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6d5dd-40c4-4e11-83d2-dfe93f634ef0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:10.873077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:10.933901 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace769c-dc25-404f-897a-8e10e8989a3b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:10.952378 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6d5dd-40c4-4e11-83d2-dfe93f634ef0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:10.970182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252713e-a948-4a30-a030-9ab637c0a7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:10.970994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252713e-a948-4a30-a030-9ab637c0a7aa None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:10.975268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252713e-a948-4a30-a030-9ab637c0a7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:10.975268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252713e-a948-4a30-a030-9ab637c0a7aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:10.975268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252713e-a948-4a30-a030-9ab637c0a7aa None admin] RBAC: Adding query filter params (interface=public, service_id=76b569cd4b98496989295297910101b7, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:10.975268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252713e-a948-4a30-a030-9ab637c0a7aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:10.975268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252713e-a948-4a30-a030-9ab637c0a7aa None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:10.984623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 455/909] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 19 15:10:10 2022] GET /identity/v3/endpoints?service_id=76b569cd4b98496989295297910101b7&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:10.985672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252713e-a948-4a30-a030-9ab637c0a7aa None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:11.004105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cf8ff-1267-42da-aaef-94d4207adfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:11.005207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cf8ff-1267-42da-aaef-94d4207adfdd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:11.006095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cf8ff-1267-42da-aaef-94d4207adfdd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:11.006581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cf8ff-1267-42da-aaef-94d4207adfdd None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:11.007456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cf8ff-1267-42da-aaef-94d4207adfdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:11.007942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cf8ff-1267-42da-aaef-94d4207adfdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:11.010382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cf8ff-1267-42da-aaef-94d4207adfdd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:11.028508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 455/910] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:11.033755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cf8ff-1267-42da-aaef-94d4207adfdd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:11.054824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:11.098382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252713e-a948-4a30-a030-9ab637c0a7aa None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:11.115691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:11.137851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156d8aa-6459-42fe-b916-b0a998629144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:11.138439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156d8aa-6459-42fe-b916-b0a998629144 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:11.138719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156d8aa-6459-42fe-b916-b0a998629144 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:11.138992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156d8aa-6459-42fe-b916-b0a998629144 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:11.139600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156d8aa-6459-42fe-b916-b0a998629144 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:11.140964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156d8aa-6459-42fe-b916-b0a998629144 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:11.154287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 456/911] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 19 15:10:10 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:10:11.155814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a81446-e2a0-4e78-b42a-bcba5fcddf26 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:11.156413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a81446-e2a0-4e78-b42a-bcba5fcddf26 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:11.156695 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a81446-e2a0-4e78-b42a-bcba5fcddf26 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:11.158977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 457/912] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:11.164696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ed80a-832c-4d25-8888-5e83ca957a08 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:11.165031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ed80a-832c-4d25-8888-5e83ca957a08 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:11.165258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ed80a-832c-4d25-8888-5e83ca957a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:11.179047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cf8ff-1267-42da-aaef-94d4207adfdd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:11.190614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8e0ed80a-832c-4d25-8888-5e83ca957a08 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:11.192297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e0ed80a-832c-4d25-8888-5e83ca957a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:11.224733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3320fdb-3c78-40a0-b53f-a8b25bda1435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:11.225313 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3320fdb-3c78-40a0-b53f-a8b25bda1435 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:11.225589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3320fdb-3c78-40a0-b53f-a8b25bda1435 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:11.225858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3320fdb-3c78-40a0-b53f-a8b25bda1435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:11.226634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3320fdb-3c78-40a0-b53f-a8b25bda1435 None admin] RBAC: Adding query filter params (role.id=ffe0dfc406a649efb1b01761d344839a, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=8e2cfbdc26484ae68545115f9751d482) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:11.226942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3320fdb-3c78-40a0-b53f-a8b25bda1435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:11.228770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3320fdb-3c78-40a0-b53f-a8b25bda1435 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:11.235204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 456/913] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:11 2022] GET /identity/v3/role_assignments?user.id=8e2cfbdc26484ae68545115f9751d482&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=ffe0dfc406a649efb1b01761d344839a => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:11.281289 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 458/914] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:11.549752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3320fdb-3c78-40a0-b53f-a8b25bda1435 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:11.573259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec6121-d8c2-47f4-9970-ed084f4bf8b3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:11.573570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec6121-d8c2-47f4-9970-ed084f4bf8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:11.573818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec6121-d8c2-47f4-9970-ed084f4bf8b3 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:11.575512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 459/915] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:11.580938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38017f4a-4d53-4522-9c31-28615bbe5746 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:11.581226 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38017f4a-4d53-4522-9c31-28615bbe5746 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:11.581506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38017f4a-4d53-4522-9c31-28615bbe5746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:11.601220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-38017f4a-4d53-4522-9c31-28615bbe5746 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:11.602541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-38017f4a-4d53-4522-9c31-28615bbe5746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:11.632777 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:11.663715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3320fdb-3c78-40a0-b53f-a8b25bda1435 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:11.694440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 460/916] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:11.704065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e1580-f7bb-4e37-9f6a-478f752de4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:11.704700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1580-f7bb-4e37-9f6a-478f752de4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:11.704978 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1580-f7bb-4e37-9f6a-478f752de4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:11.705246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e1580-f7bb-4e37-9f6a-478f752de4b2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:11.705826 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e1580-f7bb-4e37-9f6a-478f752de4b2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:11.707276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e1580-f7bb-4e37-9f6a-478f752de4b2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bf2e1580-f7bb-4e37-9f6a-478f752de4b2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:11.716824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:11.717843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:11.718761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 457/917] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:10:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:11.723946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38017f4a-4d53-4522-9c31-28615bbe5746 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:11.766377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:11.828487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38017f4a-4d53-4522-9c31-28615bbe5746 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:11.864058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcd128-f306-44bc-a981-2586c1927e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:11.864664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcd128-f306-44bc-a981-2586c1927e29 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:11.864941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcd128-f306-44bc-a981-2586c1927e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:11.865208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcd128-f306-44bc-a981-2586c1927e29 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:11.865829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcd128-f306-44bc-a981-2586c1927e29 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:11.866152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcd128-f306-44bc-a981-2586c1927e29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:11.867515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcd128-f306-44bc-a981-2586c1927e29 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:11.872568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 461/918] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:10:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:11.877972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e1580-f7bb-4e37-9f6a-478f752de4b2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:11.971463 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcd128-f306-44bc-a981-2586c1927e29 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:11.979657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e1580-f7bb-4e37-9f6a-478f752de4b2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:12.014086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00296e08-ae88-4da1-b6a6-c893e6ee1d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:12.014690 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00296e08-ae88-4da1-b6a6-c893e6ee1d3d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:12.014966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00296e08-ae88-4da1-b6a6-c893e6ee1d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:12.015217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00296e08-ae88-4da1-b6a6-c893e6ee1d3d None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:12.015850 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00296e08-ae88-4da1-b6a6-c893e6ee1d3d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:12.016150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00296e08-ae88-4da1-b6a6-c893e6ee1d3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:12.017500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00296e08-ae88-4da1-b6a6-c893e6ee1d3d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:12.022767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 458/919] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Aug 19 15:10:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:12.028618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00296e08-ae88-4da1-b6a6-c893e6ee1d3d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:12.036031 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:12.090350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcd128-f306-44bc-a981-2586c1927e29 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:12.093452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:12.133724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffd32b-1552-49c8-867d-08ceec9aaaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:12.134372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffd32b-1552-49c8-867d-08ceec9aaaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:12.134657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffd32b-1552-49c8-867d-08ceec9aaaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:12.135071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffd32b-1552-49c8-867d-08ceec9aaaf0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:12.135661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffd32b-1552-49c8-867d-08ceec9aaaf0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:12.138183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffd32b-1552-49c8-867d-08ceec9aaaf0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:12.146258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00296e08-ae88-4da1-b6a6-c893e6ee1d3d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e3ffd32b-1552-49c8-867d-08ceec9aaaf0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:12.148363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:12.149316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:12.150611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:12.155091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 462/920] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 19 15:10:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:12.155923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffd32b-1552-49c8-867d-08ceec9aaaf0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:12.193956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa04f33-12ca-466f-a472-c6779459aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:12.195047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa04f33-12ca-466f-a472-c6779459aa1c None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:12.195546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa04f33-12ca-466f-a472-c6779459aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:12.196013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa04f33-12ca-466f-a472-c6779459aa1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:12.196950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa04f33-12ca-466f-a472-c6779459aa1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:12.198893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa04f33-12ca-466f-a472-c6779459aa1c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:12.229725 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 459/921] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:10:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:10:12.270246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffd32b-1552-49c8-867d-08ceec9aaaf0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:12.319102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7b3b-066d-49d4-a6c0-9d7be182431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:12.319728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7b3b-066d-49d4-a6c0-9d7be182431e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:12.320062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7b3b-066d-49d4-a6c0-9d7be182431e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:12.320342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a7b3b-066d-49d4-a6c0-9d7be182431e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:12.320990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a7b3b-066d-49d4-a6c0-9d7be182431e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:12.321295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a7b3b-066d-49d4-a6c0-9d7be182431e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:12.322778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a7b3b-066d-49d4-a6c0-9d7be182431e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:12.329341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 463/922] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 19 15:10:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:12.334901 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa04f33-12ca-466f-a472-c6779459aa1c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:12.406357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:12.452067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa04f33-12ca-466f-a472-c6779459aa1c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:12.487113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2522f-aace-425a-ba9b-193b1a7773d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:12.487721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2522f-aace-425a-ba9b-193b1a7773d8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:12.488001 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2522f-aace-425a-ba9b-193b1a7773d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:12.488281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2522f-aace-425a-ba9b-193b1a7773d8 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:12.488915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2522f-aace-425a-ba9b-193b1a7773d8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:12.489219 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2522f-aace-425a-ba9b-193b1a7773d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:12.490619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2522f-aace-425a-ba9b-193b1a7773d8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:12.496537 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 460/923] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 19 15:10:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:12.502076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7b3b-066d-49d4-a6c0-9d7be182431e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:12.536167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:12.616032 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a7b3b-066d-49d4-a6c0-9d7be182431e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:12.651237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7af848-8624-4423-9712-83d53c48874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:12.651852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af848-8624-4423-9712-83d53c48874f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:12.652166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af848-8624-4423-9712-83d53c48874f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:12.652441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7af848-8624-4423-9712-83d53c48874f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:12.653275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7af848-8624-4423-9712-83d53c48874f None admin] RBAC: Adding query filter params (interface=public, service_id=c4494750e87b4547be55df1ca210c477, region_id=RegionOne) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:12.653585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7af848-8624-4423-9712-83d53c48874f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:12.654991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7af848-8624-4423-9712-83d53c48874f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:12.660622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 464/924] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 19 15:10:12 2022] GET /identity/v3/endpoints?service_id=c4494750e87b4547be55df1ca210c477&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:12.667159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2522f-aace-425a-ba9b-193b1a7773d8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:12.772403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2522f-aace-425a-ba9b-193b1a7773d8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:12.796683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:12.810643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bcec7-ee9d-4e8d-9808-a4bd3637ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:12.811565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bcec7-ee9d-4e8d-9808-a4bd3637ca40 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:12.812046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bcec7-ee9d-4e8d-9808-a4bd3637ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:12.812519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bcec7-ee9d-4e8d-9808-a4bd3637ca40 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:12.813352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bcec7-ee9d-4e8d-9808-a4bd3637ca40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:12.814939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bcec7-ee9d-4e8d-9808-a4bd3637ca40 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:12.821956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 461/925] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 19 15:10:12 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:10:13.147137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e13113-c4c0-48de-89eb-3a2524d6e874 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:13.147661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e13113-c4c0-48de-89eb-3a2524d6e874 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:13.147661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e13113-c4c0-48de-89eb-3a2524d6e874 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:13.149242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 465/926] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:13.155120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec6677-f1e1-481d-8e5c-b7d07462c680 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:13.155533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec6677-f1e1-481d-8e5c-b7d07462c680 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:13.155730 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec6677-f1e1-481d-8e5c-b7d07462c680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:13.174125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d2ec6677-f1e1-481d-8e5c-b7d07462c680 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:13.175301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d2ec6677-f1e1-481d-8e5c-b7d07462c680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:13.245969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 462/927] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:13.247571 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cb639-dd31-4ef8-8210-1dbd0ef9110a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:13.247881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cb639-dd31-4ef8-8210-1dbd0ef9110a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:13.248141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cb639-dd31-4ef8-8210-1dbd0ef9110a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:13.249706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 466/928] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:13.254879 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d324b7-8910-4121-a6e3-a77b3f2ef405 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:13.255163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d324b7-8910-4121-a6e3-a77b3f2ef405 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:13.255435 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d324b7-8910-4121-a6e3-a77b3f2ef405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:13.273626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-91d324b7-8910-4121-a6e3-a77b3f2ef405 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:13.274833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-91d324b7-8910-4121-a6e3-a77b3f2ef405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:13.346904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 463/929] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:13.523743 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cb639-dd31-4ef8-8210-1dbd0ef9110a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:13.616989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:13.627440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cb639-dd31-4ef8-8210-1dbd0ef9110a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:13.638214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d324b7-8910-4121-a6e3-a77b3f2ef405 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:13.662974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452c93e-3a14-4987-828c-e25ed1e650b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:13.663623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c93e-3a14-4987-828c-e25ed1e650b7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:13.663905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c93e-3a14-4987-828c-e25ed1e650b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:13.664178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c93e-3a14-4987-828c-e25ed1e650b7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:13.664759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452c93e-3a14-4987-828c-e25ed1e650b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:13.666154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452c93e-3a14-4987-828c-e25ed1e650b7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4452c93e-3a14-4987-828c-e25ed1e650b7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:13.674910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:13.675818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:13.676685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 467/930] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Aug 19 15:10:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:13.681796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452c93e-3a14-4987-828c-e25ed1e650b7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:13.714973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:13.748330 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d324b7-8910-4121-a6e3-a77b3f2ef405 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:13.785640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3351a6-5009-4974-9ebd-e0635ccb7c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:13.786632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3351a6-5009-4974-9ebd-e0635ccb7c7f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:13.787131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3351a6-5009-4974-9ebd-e0635ccb7c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:13.787612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3351a6-5009-4974-9ebd-e0635ccb7c7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:13.787823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452c93e-3a14-4987-828c-e25ed1e650b7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:13.799718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3351a6-5009-4974-9ebd-e0635ccb7c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-fb3351a6-5009-4974-9ebd-e0635ccb7c7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:13.804921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:13.805829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:13.806688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:13.814078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 464/931] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 19 15:10:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:13.815258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3351a6-5009-4974-9ebd-e0635ccb7c7f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:13.823924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a6af7-240e-446c-a46d-bada5fdfef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:13.824589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a6af7-240e-446c-a46d-bada5fdfef11 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:13.824987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a6af7-240e-446c-a46d-bada5fdfef11 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:13.825267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a6af7-240e-446c-a46d-bada5fdfef11 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:13.825910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a6af7-240e-446c-a46d-bada5fdfef11 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:13.826264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a6af7-240e-446c-a46d-bada5fdfef11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:13.827646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a6af7-240e-446c-a46d-bada5fdfef11 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:13.833075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 468/932] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 19 15:10:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:13.838886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a6af7-240e-446c-a46d-bada5fdfef11 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:13.871778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:13.941335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3351a6-5009-4974-9ebd-e0635ccb7c7f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:13.952520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:13.961765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a6af7-240e-446c-a46d-bada5fdfef11 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:13.981814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388607-1f11-466b-920a-a27e8b78eacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:13.982912 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388607-1f11-466b-920a-a27e8b78eacb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:13.983388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388607-1f11-466b-920a-a27e8b78eacb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:13.983850 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388607-1f11-466b-920a-a27e8b78eacb None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:13.984718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388607-1f11-466b-920a-a27e8b78eacb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:13.985226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388607-1f11-466b-920a-a27e8b78eacb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:13.986883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388607-1f11-466b-920a-a27e8b78eacb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:14.000764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 465/933] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 19 15:10:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:14.001885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388607-1f11-466b-920a-a27e8b78eacb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:14.004438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb368636-fc69-4d39-a48a-0b8fdc854ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:14.005052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb368636-fc69-4d39-a48a-0b8fdc854ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:14.005334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb368636-fc69-4d39-a48a-0b8fdc854ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:14.005613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb368636-fc69-4d39-a48a-0b8fdc854ac4 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:14.006281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb368636-fc69-4d39-a48a-0b8fdc854ac4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:14.006589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb368636-fc69-4d39-a48a-0b8fdc854ac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:14.008063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb368636-fc69-4d39-a48a-0b8fdc854ac4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:14.014215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 469/934] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 19 15:10:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:14.019554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb368636-fc69-4d39-a48a-0b8fdc854ac4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:14.112634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388607-1f11-466b-920a-a27e8b78eacb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:14.133113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:14.156798 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb368636-fc69-4d39-a48a-0b8fdc854ac4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:14.160025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ddf7e-e4e1-4070-80a8-f03e40167c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:14.160649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ddf7e-e4e1-4070-80a8-f03e40167c11 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:14.160920 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ddf7e-e4e1-4070-80a8-f03e40167c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:14.161183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ddf7e-e4e1-4070-80a8-f03e40167c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:14.180663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ddf7e-e4e1-4070-80a8-f03e40167c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:14.183451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ddf7e-e4e1-4070-80a8-f03e40167c11 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:14.195781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c8d20-7f6d-4e99-90ef-68a3cf5b36dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:14.196390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c8d20-7f6d-4e99-90ef-68a3cf5b36dd None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:14.196666 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c8d20-7f6d-4e99-90ef-68a3cf5b36dd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:14.196941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c8d20-7f6d-4e99-90ef-68a3cf5b36dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:14.197636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c8d20-7f6d-4e99-90ef-68a3cf5b36dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:14.199499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c8d20-7f6d-4e99-90ef-68a3cf5b36dd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-019ddf7e-e4e1-4070-80a8-f03e40167c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:14.204505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:14.205437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:14.206384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:14.206384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:14.206384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:14.210089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 466/935] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:14.213146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ddf7e-e4e1-4070-80a8-f03e40167c11 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:14.232267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 470/936] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:10:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:10:14.243752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:14.333431 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ddf7e-e4e1-4070-80a8-f03e40167c11 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:14.383479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754edc28-f7de-405b-adf5-b882ad9b73b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:14.384001 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754edc28-f7de-405b-adf5-b882ad9b73b3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:14.384276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754edc28-f7de-405b-adf5-b882ad9b73b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:14.384542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754edc28-f7de-405b-adf5-b882ad9b73b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:14.385179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754edc28-f7de-405b-adf5-b882ad9b73b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:14.385476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754edc28-f7de-405b-adf5-b882ad9b73b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:14.386964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754edc28-f7de-405b-adf5-b882ad9b73b3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:14.394179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33155a-22de-4425-b9fc-f1a4cc4d8c36 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:14.394454 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33155a-22de-4425-b9fc-f1a4cc4d8c36 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:14.394732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33155a-22de-4425-b9fc-f1a4cc4d8c36 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:14.396675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 471/937] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:10:14.402643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 467/938] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:14.403092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b6641-f94e-4ecc-b596-d159ef519682 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:14.403380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b6641-f94e-4ecc-b596-d159ef519682 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:14.403708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b6641-f94e-4ecc-b596-d159ef519682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:14.409035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754edc28-f7de-405b-adf5-b882ad9b73b3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:14.424717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-da4b6641-f94e-4ecc-b596-d159ef519682 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:14.425913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-da4b6641-f94e-4ecc-b596-d159ef519682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:14.495666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:14.499283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 472/939] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:14.522547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754edc28-f7de-405b-adf5-b882ad9b73b3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:14.560525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2e177-e110-4694-a073-7f35d75103f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:14.561166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2e177-e110-4694-a073-7f35d75103f2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:14.561452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2e177-e110-4694-a073-7f35d75103f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:14.561718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2e177-e110-4694-a073-7f35d75103f2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:14.568904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2e177-e110-4694-a073-7f35d75103f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:14.570392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2e177-e110-4694-a073-7f35d75103f2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e0f2e177-e110-4694-a073-7f35d75103f2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:10:14.582136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:14.583116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:14.584023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:14.584023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:14.584023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:10:14.584023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:10:14.584023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:10:14.584023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:10:14.584023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:10:14.584023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:10:14.584023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:10:14.584023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:14.584023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 468/940] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 19 15:10:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:14.589371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b6641-f94e-4ecc-b596-d159ef519682 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:14.662496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:14.693921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b6641-f94e-4ecc-b596-d159ef519682 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:14.730778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d480f6f-3199-4f8b-a0ca-54762fa99f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:14.731393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480f6f-3199-4f8b-a0ca-54762fa99f04 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:14.731678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480f6f-3199-4f8b-a0ca-54762fa99f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:14.731951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480f6f-3199-4f8b-a0ca-54762fa99f04 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:14.732690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d480f6f-3199-4f8b-a0ca-54762fa99f04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:14.732997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d480f6f-3199-4f8b-a0ca-54762fa99f04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:14.734457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d480f6f-3199-4f8b-a0ca-54762fa99f04 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:14.752812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 473/941] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 19 15:10:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:14.758492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2e177-e110-4694-a073-7f35d75103f2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:14.766133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281606b1-9537-40f9-9794-9bb879559a18 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:14.766707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281606b1-9537-40f9-9794-9bb879559a18 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:14.767185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281606b1-9537-40f9-9794-9bb879559a18 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:14.768691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 474/942] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:14.773743 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bc738-3959-49d5-8ec1-07c6d0925677 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:14.774296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bc738-3959-49d5-8ec1-07c6d0925677 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:14.774774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bc738-3959-49d5-8ec1-07c6d0925677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:14.793840 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9d5bc738-3959-49d5-8ec1-07c6d0925677 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:14.795072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9d5bc738-3959-49d5-8ec1-07c6d0925677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:14.866888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 475/943] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:14.870241 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bc738-3959-49d5-8ec1-07c6d0925677 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:14.893859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2e177-e110-4694-a073-7f35d75103f2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:14.932896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea83649-277e-4cab-b1c9-5836dca4376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:14.934013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83649-277e-4cab-b1c9-5836dca4376d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:14.934324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83649-277e-4cab-b1c9-5836dca4376d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:14.934639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83649-277e-4cab-b1c9-5836dca4376d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:14.943622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:14.948199 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:14.950441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea83649-277e-4cab-b1c9-5836dca4376d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:14.952442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea83649-277e-4cab-b1c9-5836dca4376d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bea83649-277e-4cab-b1c9-5836dca4376d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:14.971824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:14.972799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:14.973749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:14.973749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:14.973749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:14.973749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 469/944] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:14.979364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea83649-277e-4cab-b1c9-5836dca4376d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:14.999008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bc738-3959-49d5-8ec1-07c6d0925677 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:15.034126 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63575b-6151-434b-a5f1-6e918d9bebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:15.034791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63575b-6151-434b-a5f1-6e918d9bebb9 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:15.035108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63575b-6151-434b-a5f1-6e918d9bebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:15.035384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63575b-6151-434b-a5f1-6e918d9bebb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:15.036017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63575b-6151-434b-a5f1-6e918d9bebb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:15.037438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63575b-6151-434b-a5f1-6e918d9bebb9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:15.040071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: WARNING keystone.server.flask.common [None req-8e63575b-6151-434b-a5f1-6e918d9bebb9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 15:10:15.059547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.sql.core [None req-8e63575b-6151-434b-a5f1-6e918d9bebb9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 15:10:15.059547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 15:10:15.059547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [parameters: {'id': '1dff6d785c9f4d25b1a187176b956fd5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 15:10:15.059547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81449) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-8e63575b-6151-434b-a5f1-6e918d9bebb9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1dff6d785c9f4d25b1a187176b956fd5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1dff6d785c9f4d25b1a187176b956fd5. Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 15:10:15.070221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 15:10:15.071074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application yield resource Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise self.value Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application session.commit() Aug 19 15:10:15.072020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.flush() Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application compat.raise_( Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 15:10:15.072917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 15:10:15.073847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 15:10:15.074660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [parameters: {'id': '1dff6d785c9f4d25b1a187176b956fd5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:15.075495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:15.076260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:15.077171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:15.077171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 15:10:15.077171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 15:10:15.077171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:15.077171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:15.077171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 15:10:15.077171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 15:10:15.077171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1dff6d785c9f4d25b1a187176b956fd5. Aug 19 15:10:15.077171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:15.077171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 476/945] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Aug 19 15:10:14 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:15.077691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63575b-6151-434b-a5f1-6e918d9bebb9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:15.111861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea83649-277e-4cab-b1c9-5836dca4376d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:15.155552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93592c1-f5ce-4766-9a65-f81fde166f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:15.156157 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93592c1-f5ce-4766-9a65-f81fde166f90 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:15.156434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93592c1-f5ce-4766-9a65-f81fde166f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:15.156705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93592c1-f5ce-4766-9a65-f81fde166f90 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:15.157343 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93592c1-f5ce-4766-9a65-f81fde166f90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:15.157643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93592c1-f5ce-4766-9a65-f81fde166f90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:15.159041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93592c1-f5ce-4766-9a65-f81fde166f90 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:15.171709 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 470/946] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:15.172524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93592c1-f5ce-4766-9a65-f81fde166f90 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:15.194886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63575b-6151-434b-a5f1-6e918d9bebb9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:15.214302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:15.228255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:15.238703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf01ba-57ab-4a3e-9597-4565fceca01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:15.239338 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf01ba-57ab-4a3e-9597-4565fceca01e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:15.239615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf01ba-57ab-4a3e-9597-4565fceca01e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:15.239884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf01ba-57ab-4a3e-9597-4565fceca01e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:15.247069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf01ba-57ab-4a3e-9597-4565fceca01e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:15.248699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf01ba-57ab-4a3e-9597-4565fceca01e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c6bf01ba-57ab-4a3e-9597-4565fceca01e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:10:15.260827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:15.261832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:15.263075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:10:15.263075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:10:15.263075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:10:15.263075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:10:15.263075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:10:15.263075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:10:15.263075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:15.263075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:15.263075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 477/947] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:15.263075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf01ba-57ab-4a3e-9597-4565fceca01e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:15.290575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93592c1-f5ce-4766-9a65-f81fde166f90 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:15.326795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264e56c-cb8f-4850-9740-118982a4eb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:15.327445 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264e56c-cb8f-4850-9740-118982a4eb89 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:15.327753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264e56c-cb8f-4850-9740-118982a4eb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:15.328025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264e56c-cb8f-4850-9740-118982a4eb89 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:15.328635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264e56c-cb8f-4850-9740-118982a4eb89 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:15.330140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264e56c-cb8f-4850-9740-118982a4eb89 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0264e56c-cb8f-4850-9740-118982a4eb89 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:15.338786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:15.340315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:15.343173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 471/948] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 19 15:10:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:15.343964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264e56c-cb8f-4850-9740-118982a4eb89 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:15.372603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf01ba-57ab-4a3e-9597-4565fceca01e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:15.408633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e08b5f-de14-4776-811e-cf230f9de4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:15.409333 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e08b5f-de14-4776-811e-cf230f9de4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:15.409616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e08b5f-de14-4776-811e-cf230f9de4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:15.409886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e08b5f-de14-4776-811e-cf230f9de4d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:15.416756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e08b5f-de14-4776-811e-cf230f9de4d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:15.418788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e08b5f-de14-4776-811e-cf230f9de4d7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-e1e08b5f-de14-4776-811e-cf230f9de4d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:10:15.429951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:15.430959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:15.431838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:10:15.431838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:10:15.431838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:10:15.431838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:10:15.431838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:10:15.431838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:10:15.431838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:15.431838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:15.431838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 478/949] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:15.431838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e08b5f-de14-4776-811e-cf230f9de4d7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:15.456713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264e56c-cb8f-4850-9740-118982a4eb89 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:15.471728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:15.473612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:15.498184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb10025-c9fa-4eb8-9ba6-6df343735444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:15.499215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10025-c9fa-4eb8-9ba6-6df343735444 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:15.499611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10025-c9fa-4eb8-9ba6-6df343735444 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:15.499892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb10025-c9fa-4eb8-9ba6-6df343735444 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:15.500715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb10025-c9fa-4eb8-9ba6-6df343735444 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:15.501022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb10025-c9fa-4eb8-9ba6-6df343735444 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:15.503029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb10025-c9fa-4eb8-9ba6-6df343735444 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:15.525279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 472/950] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:10:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:15.526226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb10025-c9fa-4eb8-9ba6-6df343735444 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:15.542765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e08b5f-de14-4776-811e-cf230f9de4d7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:15.588034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78440cf9-9e9f-452f-a0b0-85adef258b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:15.589080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440cf9-9e9f-452f-a0b0-85adef258b0e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:15.590076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440cf9-9e9f-452f-a0b0-85adef258b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:15.590502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440cf9-9e9f-452f-a0b0-85adef258b0e None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:15.591342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78440cf9-9e9f-452f-a0b0-85adef258b0e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:15.591852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78440cf9-9e9f-452f-a0b0-85adef258b0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:15.593651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78440cf9-9e9f-452f-a0b0-85adef258b0e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:15.607979 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 479/951] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 19 15:10:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:15.609240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78440cf9-9e9f-452f-a0b0-85adef258b0e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:15.666061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb10025-c9fa-4eb8-9ba6-6df343735444 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:15.711380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afab7b-569e-4482-9dd2-ee24b9e6e748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:15.711380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afab7b-569e-4482-9dd2-ee24b9e6e748 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:15.711380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afab7b-569e-4482-9dd2-ee24b9e6e748 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:15.711380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afab7b-569e-4482-9dd2-ee24b9e6e748 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:15.713185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afab7b-569e-4482-9dd2-ee24b9e6e748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:15.713185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afab7b-569e-4482-9dd2-ee24b9e6e748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:15.716316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afab7b-569e-4482-9dd2-ee24b9e6e748 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:15.725679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:15.729747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 473/952] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:10:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:15.731834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78440cf9-9e9f-452f-a0b0-85adef258b0e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:15.741285 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afab7b-569e-4482-9dd2-ee24b9e6e748 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:15.776275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120e8e5-2ea3-4b76-aa26-49f83c71590b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:15.777693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e8e5-2ea3-4b76-aa26-49f83c71590b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:15.778155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e8e5-2ea3-4b76-aa26-49f83c71590b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:15.778424 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120e8e5-2ea3-4b76-aa26-49f83c71590b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:15.779052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120e8e5-2ea3-4b76-aa26-49f83c71590b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:15.779350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120e8e5-2ea3-4b76-aa26-49f83c71590b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:15.780702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120e8e5-2ea3-4b76-aa26-49f83c71590b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:15.782284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:15.788497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 480/953] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 19 15:10:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:15.794314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120e8e5-2ea3-4b76-aa26-49f83c71590b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:15.858180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afab7b-569e-4482-9dd2-ee24b9e6e748 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:15.899442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b107a3-a713-4f3a-a34c-67b8dda83608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:15.900217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b107a3-a713-4f3a-a34c-67b8dda83608 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:15.900500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b107a3-a713-4f3a-a34c-67b8dda83608 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:15.900776 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b107a3-a713-4f3a-a34c-67b8dda83608 None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/8e2cfbdc26484ae68545115f9751d482/roles/ffe0dfc406a649efb1b01761d344839a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:15.903190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b107a3-a713-4f3a-a34c-67b8dda83608 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=8e2cfbdc26484ae68545115f9751d482, role_id=ffe0dfc406a649efb1b01761d344839a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:15.904726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b107a3-a713-4f3a-a34c-67b8dda83608 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:15.907038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120e8e5-2ea3-4b76-aa26-49f83c71590b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:15.919503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 474/954] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:10:15 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/8e2cfbdc26484ae68545115f9751d482/roles/ffe0dfc406a649efb1b01761d344839a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:10:15.946920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fad360-eb71-486c-82b8-19a8777a3538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:15.947851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fad360-eb71-486c-82b8-19a8777a3538 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:15.948296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fad360-eb71-486c-82b8-19a8777a3538 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:15.948711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fad360-eb71-486c-82b8-19a8777a3538 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:15.950139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fad360-eb71-486c-82b8-19a8777a3538 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:15.951729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fad360-eb71-486c-82b8-19a8777a3538 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:15.977036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 481/955] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:10:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:10:16.257545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915d6a-ab4f-409c-9783-d8ae0537edcb None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:16.258070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915d6a-ab4f-409c-9783-d8ae0537edcb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:16.258160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d915d6a-ab4f-409c-9783-d8ae0537edcb None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:16.259697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 475/956] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:16.265271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d6482-57b2-4685-aefd-38e0e518788b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:16.265689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d6482-57b2-4685-aefd-38e0e518788b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:16.265831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d6482-57b2-4685-aefd-38e0e518788b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:16.284223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9c4d6482-57b2-4685-aefd-38e0e518788b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:16.285754 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9c4d6482-57b2-4685-aefd-38e0e518788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:16.300325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:16.370144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 482/957] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:16.635614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d915d6a-ab4f-409c-9783-d8ae0537edcb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:16.734170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:16.742381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d915d6a-ab4f-409c-9783-d8ae0537edcb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:16.779775 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449495bc-05a4-42bb-9bc6-18ddfbf79220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:16.780403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449495bc-05a4-42bb-9bc6-18ddfbf79220 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:16.780680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449495bc-05a4-42bb-9bc6-18ddfbf79220 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:16.780998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449495bc-05a4-42bb-9bc6-18ddfbf79220 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:16.781579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449495bc-05a4-42bb-9bc6-18ddfbf79220 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:16.782965 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449495bc-05a4-42bb-9bc6-18ddfbf79220 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-449495bc-05a4-42bb-9bc6-18ddfbf79220 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:16.791568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:16.792711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:10:16.794286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:16.798228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 476/958] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:16.799581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d6482-57b2-4685-aefd-38e0e518788b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:16.904781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d6482-57b2-4685-aefd-38e0e518788b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:16.942006 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b4617-ddf4-4225-90be-68b28c4e9b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:16.942992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4617-ddf4-4225-90be-68b28c4e9b32 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:16.943466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4617-ddf4-4225-90be-68b28c4e9b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:16.943915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4617-ddf4-4225-90be-68b28c4e9b32 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:16.944724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b4617-ddf4-4225-90be-68b28c4e9b32 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:16.945200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b4617-ddf4-4225-90be-68b28c4e9b32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:16.946764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b4617-ddf4-4225-90be-68b28c4e9b32 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:16.952635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 483/959] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:10:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:16.958259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449495bc-05a4-42bb-9bc6-18ddfbf79220 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:17.064008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449495bc-05a4-42bb-9bc6-18ddfbf79220 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:17.101656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1679c8-ef7d-481a-a757-859295382fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:17.102298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1679c8-ef7d-481a-a757-859295382fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:17.102584 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1679c8-ef7d-481a-a757-859295382fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:17.102859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1679c8-ef7d-481a-a757-859295382fa9 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:17.103499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1679c8-ef7d-481a-a757-859295382fa9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:17.103803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1679c8-ef7d-481a-a757-859295382fa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:17.105485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1679c8-ef7d-481a-a757-859295382fa9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:17.110526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 477/960] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:10:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:17.591919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36336c4-6000-4a58-8125-f9beac6785c4 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:17.592433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36336c4-6000-4a58-8125-f9beac6785c4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:17.592613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36336c4-6000-4a58-8125-f9beac6785c4 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:17.594318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 484/961] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:17.599434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69c5ce-f525-45c5-b6ec-4ec0a2e08993 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:17.599833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69c5ce-f525-45c5-b6ec-4ec0a2e08993 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:17.600113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69c5ce-f525-45c5-b6ec-4ec0a2e08993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:17.618955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7f69c5ce-f525-45c5-b6ec-4ec0a2e08993 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:17.620141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7f69c5ce-f525-45c5-b6ec-4ec0a2e08993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:17.639109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:17.692546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 478/962] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:17.953268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1684-893f-4773-8d6b-b0c173bc6437 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:17.953616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1684-893f-4773-8d6b-b0c173bc6437 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:17.953796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c1684-893f-4773-8d6b-b0c173bc6437 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:17.955347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 485/963] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:17.960853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89830e-b897-4f88-a6ab-cf5ac0af3bc3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:17.961081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89830e-b897-4f88-a6ab-cf5ac0af3bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:17.961357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89830e-b897-4f88-a6ab-cf5ac0af3bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:17.961827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1684-893f-4773-8d6b-b0c173bc6437 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:17.973715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:17.989036 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ed89830e-b897-4f88-a6ab-cf5ac0af3bc3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:17.990400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ed89830e-b897-4f88-a6ab-cf5ac0af3bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:18.073551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 479/964] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:18.074873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228540d-2b87-445d-849d-e61b44417f2e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:18.075153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228540d-2b87-445d-849d-e61b44417f2e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:18.075418 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228540d-2b87-445d-849d-e61b44417f2e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:18.077081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 480/965] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:18.082233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd354-084d-4e35-9151-41a76a145c44 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:18.082640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd354-084d-4e35-9151-41a76a145c44 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:18.082919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edd354-084d-4e35-9151-41a76a145c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:18.094932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c1684-893f-4773-8d6b-b0c173bc6437 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:18.109303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a9edd354-084d-4e35-9151-41a76a145c44 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:18.110694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a9edd354-084d-4e35-9151-41a76a145c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:18.132705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672252f-2833-40f6-aae7-92b264f5bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:18.133674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672252f-2833-40f6-aae7-92b264f5bc8b None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:18.134227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672252f-2833-40f6-aae7-92b264f5bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:18.134724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672252f-2833-40f6-aae7-92b264f5bc8b None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:18.135576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672252f-2833-40f6-aae7-92b264f5bc8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:18.137250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672252f-2833-40f6-aae7-92b264f5bc8b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:18.153142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.sql.core [None req-9672252f-2833-40f6-aae7-92b264f5bc8b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 15:10:18.153142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 15:10:18.153142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [parameters: {'user_id': 'dced72bad0fd4c0ebaae271dd52347db', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 15:10:18.153142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81449) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9672252f-2833-40f6-aae7-92b264f5bc8b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Aug 19 15:10:18.160931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 15:10:18.161849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application yield resource Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application next(self.gen) Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise self.value Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application session.commit() Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 15:10:18.162884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.session.flush() Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application compat.raise_( Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 15:10:18.163804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 15:10:18.164720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application conn.query(q) Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application result.read() Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 15:10:18.167381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [parameters: {'user_id': 'dced72bad0fd4c0ebaae271dd52347db', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:18.170015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 15:10:18.172057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 15:10:18.175929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 15:10:18.175929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 15:10:18.175929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 15:10:18.175929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 15:10:18.175929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 15:10:18.175929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:18.177143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 486/966] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Aug 19 15:10:17 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:18.186048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 481/967] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:18.187269 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672252f-2833-40f6-aae7-92b264f5bc8b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:18.266144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:18.300262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672252f-2833-40f6-aae7-92b264f5bc8b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:18.335135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb562639-a521-4530-8a27-295486f17d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:18.336119 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb562639-a521-4530-8a27-295486f17d6e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:18.336627 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb562639-a521-4530-8a27-295486f17d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:18.337136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb562639-a521-4530-8a27-295486f17d6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:18.346143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb562639-a521-4530-8a27-295486f17d6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:18.348057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb562639-a521-4530-8a27-295486f17d6e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:18.353411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edd354-084d-4e35-9151-41a76a145c44 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-eb562639-a521-4530-8a27-295486f17d6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:10:18.360638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:18.361593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:18.362611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:18.362611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:18.362611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:10:18.362611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:10:18.362611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:10:18.362611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:10:18.362611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:10:18.362611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:10:18.362611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 15:10:18.362611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:18.365084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 487/968] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:10:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:18.368904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:18.371878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb562639-a521-4530-8a27-295486f17d6e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:18.471811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edd354-084d-4e35-9151-41a76a145c44 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:18.486641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb562639-a521-4530-8a27-295486f17d6e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:18.510297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb8473-0b70-4640-ab7d-9cedc3f1185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:18.510920 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb8473-0b70-4640-ab7d-9cedc3f1185e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:18.511836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb8473-0b70-4640-ab7d-9cedc3f1185e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:18.511995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb8473-0b70-4640-ab7d-9cedc3f1185e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:18.516531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:18.522310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb8473-0b70-4640-ab7d-9cedc3f1185e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:18.523339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42c15b-a894-41cf-b8f8-c01f9bb684e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:18.524040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42c15b-a894-41cf-b8f8-c01f9bb684e0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:18.524439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42c15b-a894-41cf-b8f8-c01f9bb684e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:18.524811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42c15b-a894-41cf-b8f8-c01f9bb684e0 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:18.525610 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42c15b-a894-41cf-b8f8-c01f9bb684e0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:18.529017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42c15b-a894-41cf-b8f8-c01f9bb684e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b3cb8473-0b70-4640-ab7d-9cedc3f1185e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:18.529167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:18.530339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:18.531359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:18.534080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42c15b-a894-41cf-b8f8-c01f9bb684e0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:18.534244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 482/969] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 19 15:10:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:18.534244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb8473-0b70-4640-ab7d-9cedc3f1185e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:18.569146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 488/970] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Aug 19 15:10:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:18.569994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42c15b-a894-41cf-b8f8-c01f9bb684e0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:18.641282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:18.682270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb8473-0b70-4640-ab7d-9cedc3f1185e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:18.687680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42c15b-a894-41cf-b8f8-c01f9bb684e0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:18.729480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f45d93-5a84-4282-b9f4-526f8f2b4689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:18.730316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f45d93-5a84-4282-b9f4-526f8f2b4689 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:18.730594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f45d93-5a84-4282-b9f4-526f8f2b4689 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:18.730863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f45d93-5a84-4282-b9f4-526f8f2b4689 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:18.731446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f45d93-5a84-4282-b9f4-526f8f2b4689 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:18.732397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579cbc6-9868-4c5c-a3b9-0ce1e96ea75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:18.732799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f45d93-5a84-4282-b9f4-526f8f2b4689 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:18.733006 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579cbc6-9868-4c5c-a3b9-0ce1e96ea75c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:18.733285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579cbc6-9868-4c5c-a3b9-0ce1e96ea75c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:18.733555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579cbc6-9868-4c5c-a3b9-0ce1e96ea75c None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:18.734600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579cbc6-9868-4c5c-a3b9-0ce1e96ea75c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:18.734828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579cbc6-9868-4c5c-a3b9-0ce1e96ea75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:18.736656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579cbc6-9868-4c5c-a3b9-0ce1e96ea75c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:18.745736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 489/971] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 19 15:10:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-72f45d93-5a84-4282-b9f4-526f8f2b4689 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:18.746544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:18.747574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:18.748434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:18.752814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 483/972] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 19 15:10:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:18.753745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579cbc6-9868-4c5c-a3b9-0ce1e96ea75c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:18.754951 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f45d93-5a84-4282-b9f4-526f8f2b4689 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:18.820046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:18.883007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f45d93-5a84-4282-b9f4-526f8f2b4689 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:18.885264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579cbc6-9868-4c5c-a3b9-0ce1e96ea75c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:18.919452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c3dc9-c44c-4a13-9a19-242b28304175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:18.920067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c3dc9-c44c-4a13-9a19-242b28304175 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:18.920349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c3dc9-c44c-4a13-9a19-242b28304175 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:18.920449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6e4ca-8935-418e-8e75-0a89e3c72f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:18.920638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c3dc9-c44c-4a13-9a19-242b28304175 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:18.921062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6e4ca-8935-418e-8e75-0a89e3c72f17 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:18.921262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c3dc9-c44c-4a13-9a19-242b28304175 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:18.921358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6e4ca-8935-418e-8e75-0a89e3c72f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:18.921567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c3dc9-c44c-4a13-9a19-242b28304175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:18.921664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6e4ca-8935-418e-8e75-0a89e3c72f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:18.922974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c3dc9-c44c-4a13-9a19-242b28304175 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:18.925079 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:18.929683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 484/973] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 19 15:10:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:18.932869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6e4ca-8935-418e-8e75-0a89e3c72f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:18.934720 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c3dc9-c44c-4a13-9a19-242b28304175 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:18.934884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6e4ca-8935-418e-8e75-0a89e3c72f17 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-97d6e4ca-8935-418e-8e75-0a89e3c72f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:18.949688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:18.950709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:18.951605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:18.951605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:18.951605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:18.951605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 490/974] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:18.959288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6e4ca-8935-418e-8e75-0a89e3c72f17 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:19.039507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c3dc9-c44c-4a13-9a19-242b28304175 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:19.074905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6e4ca-8935-418e-8e75-0a89e3c72f17 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:19.076335 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:19.076681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0e5ec-57db-4da6-87d9-e41aad2d8b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:19.077295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e5ec-57db-4da6-87d9-e41aad2d8b19 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:19.077579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e5ec-57db-4da6-87d9-e41aad2d8b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:19.077921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e5ec-57db-4da6-87d9-e41aad2d8b19 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:19.078517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0e5ec-57db-4da6-87d9-e41aad2d8b19 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:19.078823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0e5ec-57db-4da6-87d9-e41aad2d8b19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:19.080186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0e5ec-57db-4da6-87d9-e41aad2d8b19 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:19.084892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 485/975] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 19 15:10:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:19.086137 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d4a2b-5db6-4afe-986f-6bbdf9b4e7f3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:19.086428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d4a2b-5db6-4afe-986f-6bbdf9b4e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:19.086703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d4a2b-5db6-4afe-986f-6bbdf9b4e7f3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:19.087926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 486/976] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:19.091038 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d4a2b-5db6-4afe-986f-6bbdf9b4e7f3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:19.113247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45e5e6-8fd8-40c8-a9cc-68d364669998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:19.113853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e5e6-8fd8-40c8-a9cc-68d364669998 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:19.114162 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e5e6-8fd8-40c8-a9cc-68d364669998 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:19.114438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45e5e6-8fd8-40c8-a9cc-68d364669998 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:19.115080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e5e6-8fd8-40c8-a9cc-68d364669998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:19.115385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e5e6-8fd8-40c8-a9cc-68d364669998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:19.116742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45e5e6-8fd8-40c8-a9cc-68d364669998 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:19.127622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 491/977] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:19.128907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c3dc-32be-4bce-82bb-6446f4c2d4fa None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:19.129194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c3dc-32be-4bce-82bb-6446f4c2d4fa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:19.129470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0c3dc-32be-4bce-82bb-6446f4c2d4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:19.146243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-19c0c3dc-32be-4bce-82bb-6446f4c2d4fa None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:19.147755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-19c0c3dc-32be-4bce-82bb-6446f4c2d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:19.158781 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:19.195967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d4a2b-5db6-4afe-986f-6bbdf9b4e7f3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:19.212158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 492/978] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:19.212972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c3dc-32be-4bce-82bb-6446f4c2d4fa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:19.236225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd45b10-a4fa-4289-bc67-d449b79a3571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:19.237383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd45b10-a4fa-4289-bc67-d449b79a3571 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:19.238096 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd45b10-a4fa-4289-bc67-d449b79a3571 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:19.238573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd45b10-a4fa-4289-bc67-d449b79a3571 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:19.239910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd45b10-a4fa-4289-bc67-d449b79a3571 None admin] RBAC: Adding query filter params (interface=admin, service_id=c4494750e87b4547be55df1ca210c477, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:19.240536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd45b10-a4fa-4289-bc67-d449b79a3571 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:19.242316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd45b10-a4fa-4289-bc67-d449b79a3571 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:19.249155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 487/979] 10.222.0.20 () {56 vars in 1249 bytes} [Fri Aug 19 15:10:19 2022] GET /identity/v3/endpoints?service_id=c4494750e87b4547be55df1ca210c477&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:19.254622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd45b10-a4fa-4289-bc67-d449b79a3571 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:19.305373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:19.315892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0c3dc-32be-4bce-82bb-6446f4c2d4fa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:19.355712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db57e1e-135b-4e5c-a5fa-14fecbbe96a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:19.356828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db57e1e-135b-4e5c-a5fa-14fecbbe96a3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:19.357325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db57e1e-135b-4e5c-a5fa-14fecbbe96a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:19.357818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db57e1e-135b-4e5c-a5fa-14fecbbe96a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:19.365688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db57e1e-135b-4e5c-a5fa-14fecbbe96a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:19.367447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db57e1e-135b-4e5c-a5fa-14fecbbe96a3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:19.371235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd45b10-a4fa-4289-bc67-d449b79a3571 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5db57e1e-135b-4e5c-a5fa-14fecbbe96a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:10:19.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:19.380734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:19.381683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:19.381683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:19.381683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:10:19.381683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:10:19.381683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:10:19.381683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:10:19.381683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:10:19.381683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:10:19.381683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 19 15:10:19.381683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:19.382688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 493/980] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 19 15:10:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:19.388316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db57e1e-135b-4e5c-a5fa-14fecbbe96a3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:19.400702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:19.410226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077bcc9-d52b-447b-ad52-3f952c19cfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:19.410836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077bcc9-d52b-447b-ad52-3f952c19cfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:19.411115 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077bcc9-d52b-447b-ad52-3f952c19cfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:19.411387 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077bcc9-d52b-447b-ad52-3f952c19cfb8 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:19.411992 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077bcc9-d52b-447b-ad52-3f952c19cfb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:19.413359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077bcc9-d52b-447b-ad52-3f952c19cfb8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:19.419182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 488/981] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 19 15:10:19 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:10:19.478755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077bcc9-d52b-447b-ad52-3f952c19cfb8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:19.514188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db57e1e-135b-4e5c-a5fa-14fecbbe96a3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:19.557661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c7b68-63c8-4ef6-8d1d-eeb62d63d618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:19.558847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c7b68-63c8-4ef6-8d1d-eeb62d63d618 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:19.559130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c7b68-63c8-4ef6-8d1d-eeb62d63d618 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:19.559407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c7b68-63c8-4ef6-8d1d-eeb62d63d618 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:19.560151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c7b68-63c8-4ef6-8d1d-eeb62d63d618 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:19.560463 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c7b68-63c8-4ef6-8d1d-eeb62d63d618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:19.562238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c7b68-63c8-4ef6-8d1d-eeb62d63d618 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:19.581588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 494/982] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Aug 19 15:10:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:19.587523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c7b68-63c8-4ef6-8d1d-eeb62d63d618 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:19.599332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:19.604732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077bcc9-d52b-447b-ad52-3f952c19cfb8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:19.642113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b778e6-5cca-429e-86c4-93711acfe3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:19.642824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b778e6-5cca-429e-86c4-93711acfe3cf None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:19.642921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b778e6-5cca-429e-86c4-93711acfe3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:19.643138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b778e6-5cca-429e-86c4-93711acfe3cf None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:19.643774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b778e6-5cca-429e-86c4-93711acfe3cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:19.645118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b778e6-5cca-429e-86c4-93711acfe3cf None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:19.666125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 489/983] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:10:19 2022] POST /identity/v3/services => generated 242 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:10:19.703444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c7b68-63c8-4ef6-8d1d-eeb62d63d618 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:19.751385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d386b-1072-497e-a01c-9c09189af239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:19.752200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d386b-1072-497e-a01c-9c09189af239 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:19.752581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d386b-1072-497e-a01c-9c09189af239 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:19.752950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d386b-1072-497e-a01c-9c09189af239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:19.829835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d386b-1072-497e-a01c-9c09189af239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:19.831335 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d386b-1072-497e-a01c-9c09189af239 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:19.840009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:19.938562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 495/984] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:19 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 15:10:19.944755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b778e6-5cca-429e-86c4-93711acfe3cf None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:19.999780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:20.049764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b778e6-5cca-429e-86c4-93711acfe3cf None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:20.083518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb02ed2-c941-4916-8ab0-92dcc9cbe645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:20.084148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb02ed2-c941-4916-8ab0-92dcc9cbe645 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:20.084428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb02ed2-c941-4916-8ab0-92dcc9cbe645 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:20.084700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb02ed2-c941-4916-8ab0-92dcc9cbe645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:20.095051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb02ed2-c941-4916-8ab0-92dcc9cbe645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:20.096484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb02ed2-c941-4916-8ab0-92dcc9cbe645 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-0eb02ed2-c941-4916-8ab0-92dcc9cbe645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:20.110928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:20.111889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:20.112783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:20.112783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:20.112783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:20.113534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 490/985] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:20.117818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d386b-1072-497e-a01c-9c09189af239 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:20.220074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d386b-1072-497e-a01c-9c09189af239 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:20.227509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:20.256242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac4b4-91a0-4da6-b941-f295ad37fe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:20.256977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac4b4-91a0-4da6-b941-f295ad37fe7d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:20.257358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac4b4-91a0-4da6-b941-f295ad37fe7d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:20.257779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac4b4-91a0-4da6-b941-f295ad37fe7d None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:20.258562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ac4b4-91a0-4da6-b941-f295ad37fe7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:20.258965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ac4b4-91a0-4da6-b941-f295ad37fe7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:20.260450 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ac4b4-91a0-4da6-b941-f295ad37fe7d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:20.271794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 496/986] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:20.277359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb02ed2-c941-4916-8ab0-92dcc9cbe645 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:20.377925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb02ed2-c941-4916-8ab0-92dcc9cbe645 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:20.380288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:20.414996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435325cf-6ccc-48a6-a56a-5a82af7fb2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:20.415877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435325cf-6ccc-48a6-a56a-5a82af7fb2be None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:20.416310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435325cf-6ccc-48a6-a56a-5a82af7fb2be None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:20.416730 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435325cf-6ccc-48a6-a56a-5a82af7fb2be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:20.424134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435325cf-6ccc-48a6-a56a-5a82af7fb2be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:20.425773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435325cf-6ccc-48a6-a56a-5a82af7fb2be None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-435325cf-6ccc-48a6-a56a-5a82af7fb2be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:10:20.437358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:20.438457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:20.439548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:10:20.439548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:10:20.439548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:10:20.439548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:10:20.439548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:10:20.439548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:10:20.439548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:20.439548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:20.441201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 491/987] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:20.446941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac4b4-91a0-4da6-b941-f295ad37fe7d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:20.556053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac4b4-91a0-4da6-b941-f295ad37fe7d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:20.588738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a7fa5-40b3-4928-8982-5f731577c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:20.589996 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a7fa5-40b3-4928-8982-5f731577c353 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:20.590307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a7fa5-40b3-4928-8982-5f731577c353 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:20.590580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a7fa5-40b3-4928-8982-5f731577c353 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:20.591271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a7fa5-40b3-4928-8982-5f731577c353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:20.591582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a7fa5-40b3-4928-8982-5f731577c353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:20.593004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a7fa5-40b3-4928-8982-5f731577c353 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:20.605490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 497/988] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:20.611383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435325cf-6ccc-48a6-a56a-5a82af7fb2be None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:20.714047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435325cf-6ccc-48a6-a56a-5a82af7fb2be None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:20.748491 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9d99d-9602-4275-95b3-aec44b5aa8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:20.749117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9d99d-9602-4275-95b3-aec44b5aa8bc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:20.749402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9d99d-9602-4275-95b3-aec44b5aa8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:20.749679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9d99d-9602-4275-95b3-aec44b5aa8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:20.750466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9d99d-9602-4275-95b3-aec44b5aa8bc None admin] RBAC: Adding query filter params (role.id=ffe0dfc406a649efb1b01761d344839a, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=8e2cfbdc26484ae68545115f9751d482) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:20.750780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9d99d-9602-4275-95b3-aec44b5aa8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:20.752249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9d99d-9602-4275-95b3-aec44b5aa8bc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:20.766080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 492/989] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:20 2022] GET /identity/v3/role_assignments?user.id=8e2cfbdc26484ae68545115f9751d482&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=ffe0dfc406a649efb1b01761d344839a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:21.307666 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f66b0b-bd43-48b9-8c39-5bc098b9663e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:21.308722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f66b0b-bd43-48b9-8c39-5bc098b9663e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:21.308722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f66b0b-bd43-48b9-8c39-5bc098b9663e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:21.310232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 498/990] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:21.315195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af69e-1611-4d59-9c9d-99b975d94c3d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:21.315482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af69e-1611-4d59-9c9d-99b975d94c3d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:21.315757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af69e-1611-4d59-9c9d-99b975d94c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:21.335975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-fa5af69e-1611-4d59-9c9d-99b975d94c3d None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:21.337147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fa5af69e-1611-4d59-9c9d-99b975d94c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:21.360057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:21.406246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 493/991] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:21.581445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf379e2-4037-4965-93da-18df7b4c1606 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:21.581679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf379e2-4037-4965-93da-18df7b4c1606 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:21.581940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf379e2-4037-4965-93da-18df7b4c1606 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:21.583435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 499/992] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:21.588406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272f28-bfc2-41e4-baa1-14f3da648e9b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:21.588701 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272f28-bfc2-41e4-baa1-14f3da648e9b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:21.588973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a272f28-bfc2-41e4-baa1-14f3da648e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:21.607550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1a272f28-bfc2-41e4-baa1-14f3da648e9b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:21.608718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1a272f28-bfc2-41e4-baa1-14f3da648e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:21.667134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf379e2-4037-4965-93da-18df7b4c1606 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:21.678108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 494/993] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:21.694914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:21.773493 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf379e2-4037-4965-93da-18df7b4c1606 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:21.807278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ecbdc-bbab-46cc-ba90-7dcb3a038567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:21.807907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ecbdc-bbab-46cc-ba90-7dcb3a038567 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:21.808718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ecbdc-bbab-46cc-ba90-7dcb3a038567 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:21.808997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ecbdc-bbab-46cc-ba90-7dcb3a038567 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:21.809579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ecbdc-bbab-46cc-ba90-7dcb3a038567 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:21.810975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ecbdc-bbab-46cc-ba90-7dcb3a038567 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0e9ecbdc-bbab-46cc-ba90-7dcb3a038567 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:21.819732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:21.820902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:21.821902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 500/994] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Aug 19 15:10:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:21.827439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a272f28-bfc2-41e4-baa1-14f3da648e9b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:21.916517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:21.930444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a272f28-bfc2-41e4-baa1-14f3da648e9b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:21.946413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ecbdc-bbab-46cc-ba90-7dcb3a038567 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:21.965289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd451b7-2dd2-4257-80cb-84c98bdf38b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:21.965899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd451b7-2dd2-4257-80cb-84c98bdf38b8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:21.966214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd451b7-2dd2-4257-80cb-84c98bdf38b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:21.966489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd451b7-2dd2-4257-80cb-84c98bdf38b8 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:21.967119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd451b7-2dd2-4257-80cb-84c98bdf38b8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:21.967428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd451b7-2dd2-4257-80cb-84c98bdf38b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:21.968784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd451b7-2dd2-4257-80cb-84c98bdf38b8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:21.973968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 495/995] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 19 15:10:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:21.980601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd451b7-2dd2-4257-80cb-84c98bdf38b8 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:22.050621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:22.062554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ecbdc-bbab-46cc-ba90-7dcb3a038567 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:22.082633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd451b7-2dd2-4257-80cb-84c98bdf38b8 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:22.100474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8cfa9-3a23-4a31-9629-65bd73238a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:22.101105 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8cfa9-3a23-4a31-9629-65bd73238a05 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:22.101387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8cfa9-3a23-4a31-9629-65bd73238a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:22.101705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8cfa9-3a23-4a31-9629-65bd73238a05 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:22.102441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8cfa9-3a23-4a31-9629-65bd73238a05 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:22.103815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8cfa9-3a23-4a31-9629-65bd73238a05 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ddd8cfa9-3a23-4a31-9629-65bd73238a05 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:22.113904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:22.114916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:22.115752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 501/996] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:22.119109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f70ed4-3b23-4e6a-8566-d168d9aed55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:22.119954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f70ed4-3b23-4e6a-8566-d168d9aed55a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:22.120067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f70ed4-3b23-4e6a-8566-d168d9aed55a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:22.120264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f70ed4-3b23-4e6a-8566-d168d9aed55a None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:22.120797 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8cfa9-3a23-4a31-9629-65bd73238a05 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:22.120956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f70ed4-3b23-4e6a-8566-d168d9aed55a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:22.121222 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f70ed4-3b23-4e6a-8566-d168d9aed55a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:22.122625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f70ed4-3b23-4e6a-8566-d168d9aed55a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:22.132787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 496/997] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Aug 19 15:10:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:22.133658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f70ed4-3b23-4e6a-8566-d168d9aed55a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:22.154049 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:22.228252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8cfa9-3a23-4a31-9629-65bd73238a05 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:22.243547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f70ed4-3b23-4e6a-8566-d168d9aed55a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:22.262241 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551cb5a-08fb-4251-a4fa-472c3f17148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:22.262855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551cb5a-08fb-4251-a4fa-472c3f17148b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:22.263134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551cb5a-08fb-4251-a4fa-472c3f17148b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:22.263408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551cb5a-08fb-4251-a4fa-472c3f17148b None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:22.264035 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551cb5a-08fb-4251-a4fa-472c3f17148b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:22.264337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551cb5a-08fb-4251-a4fa-472c3f17148b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:22.265704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551cb5a-08fb-4251-a4fa-472c3f17148b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:22.270495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 502/998] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:10:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:22.276129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551cb5a-08fb-4251-a4fa-472c3f17148b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:22.280762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d455e-3dc6-4533-ac1d-b467cd49735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:22.281361 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d455e-3dc6-4533-ac1d-b467cd49735d None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:22.281633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d455e-3dc6-4533-ac1d-b467cd49735d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:22.281897 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d455e-3dc6-4533-ac1d-b467cd49735d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:22.282572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d455e-3dc6-4533-ac1d-b467cd49735d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:22.283923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d455e-3dc6-4533-ac1d-b467cd49735d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:22.296827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:22.302152 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 497/999] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:10:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:10:22.396259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551cb5a-08fb-4251-a4fa-472c3f17148b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:22.437549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883b969-83b1-4619-bb83-8a28e7fc83b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:22.438816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883b969-83b1-4619-bb83-8a28e7fc83b4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:22.439094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883b969-83b1-4619-bb83-8a28e7fc83b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:22.439365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883b969-83b1-4619-bb83-8a28e7fc83b4 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:22.439992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883b969-83b1-4619-bb83-8a28e7fc83b4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:22.440293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883b969-83b1-4619-bb83-8a28e7fc83b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:22.441695 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883b969-83b1-4619-bb83-8a28e7fc83b4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:22.447376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 503/1000] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:10:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:22.453503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d455e-3dc6-4533-ac1d-b467cd49735d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:22.542274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:22.569383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d455e-3dc6-4533-ac1d-b467cd49735d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:22.604395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8abbf-a22b-4a75-94a2-5b3ab4907715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:22.605546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8abbf-a22b-4a75-94a2-5b3ab4907715 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:22.605822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8abbf-a22b-4a75-94a2-5b3ab4907715 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:22.606117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8abbf-a22b-4a75-94a2-5b3ab4907715 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:22.606813 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8abbf-a22b-4a75-94a2-5b3ab4907715 None admin] RBAC: Adding query filter params (interface=public, service_id=5b451f830a3c4ae18c0e91c7a1824525, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:22.607117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8abbf-a22b-4a75-94a2-5b3ab4907715 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:22.608465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8abbf-a22b-4a75-94a2-5b3ab4907715 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:22.617979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 498/1001] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 19 15:10:22 2022] GET /identity/v3/endpoints?service_id=5b451f830a3c4ae18c0e91c7a1824525&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:22.619540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883b969-83b1-4619-bb83-8a28e7fc83b4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:22.698233 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:22.713309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3002d9-2e8e-4b04-8a96-cabfa682518b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:22.713604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3002d9-2e8e-4b04-8a96-cabfa682518b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:22.713865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3002d9-2e8e-4b04-8a96-cabfa682518b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:22.716023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 499/1002] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:22.720858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05207ebc-ece2-4d5e-a3c5-3f1efadaf0d4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:22.721373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05207ebc-ece2-4d5e-a3c5-3f1efadaf0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:22.721588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883b969-83b1-4619-bb83-8a28e7fc83b4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:22.722012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05207ebc-ece2-4d5e-a3c5-3f1efadaf0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:22.743348 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-05207ebc-ece2-4d5e-a3c5-3f1efadaf0d4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:22.744707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-05207ebc-ece2-4d5e-a3c5-3f1efadaf0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:22.756433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92e451-8d33-4b7f-8368-9a26dc7c07d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:22.757037 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e451-8d33-4b7f-8368-9a26dc7c07d4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:22.757315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e451-8d33-4b7f-8368-9a26dc7c07d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:22.757586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92e451-8d33-4b7f-8368-9a26dc7c07d4 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:22.758218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92e451-8d33-4b7f-8368-9a26dc7c07d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:22.759577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92e451-8d33-4b7f-8368-9a26dc7c07d4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:22.766064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 504/1003] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 19 15:10:22 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:10:22.829163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 500/1004] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:23.099393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92e451-8d33-4b7f-8368-9a26dc7c07d4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:23.199892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92e451-8d33-4b7f-8368-9a26dc7c07d4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:23.236377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358cff5-a827-47bd-9c0f-0fff3f4d1ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:23.237010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358cff5-a827-47bd-9c0f-0fff3f4d1ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:23.237288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358cff5-a827-47bd-9c0f-0fff3f4d1ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:23.237562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358cff5-a827-47bd-9c0f-0fff3f4d1ce9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:23.238179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358cff5-a827-47bd-9c0f-0fff3f4d1ce9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:23.239542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358cff5-a827-47bd-9c0f-0fff3f4d1ce9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-9358cff5-a827-47bd-9c0f-0fff3f4d1ce9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:23.249122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:23.250103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:23.250942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 505/1005] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Aug 19 15:10:23 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:23.256112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05207ebc-ece2-4d5e-a3c5-3f1efadaf0d4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:23.326615 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:23.360838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05207ebc-ece2-4d5e-a3c5-3f1efadaf0d4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:23.394197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3718b2-c7a4-44d5-9da2-f2f97706438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:23.394806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3718b2-c7a4-44d5-9da2-f2f97706438a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:23.395088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3718b2-c7a4-44d5-9da2-f2f97706438a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:23.395359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3718b2-c7a4-44d5-9da2-f2f97706438a None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:23.395991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3718b2-c7a4-44d5-9da2-f2f97706438a None admin] RBAC: Adding query filter params (name=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:23.396295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3718b2-c7a4-44d5-9da2-f2f97706438a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:23.397653 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3718b2-c7a4-44d5-9da2-f2f97706438a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:23.407559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 501/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:23.409213 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358cff5-a827-47bd-9c0f-0fff3f4d1ce9 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:23.422070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:23.508530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358cff5-a827-47bd-9c0f-0fff3f4d1ce9 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:23.543412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849242e-ffa7-43e7-9d13-c25734e77774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:23.544020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849242e-ffa7-43e7-9d13-c25734e77774 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:23.544302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849242e-ffa7-43e7-9d13-c25734e77774 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:23.544576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849242e-ffa7-43e7-9d13-c25734e77774 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:23.545206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849242e-ffa7-43e7-9d13-c25734e77774 None admin] RBAC: Adding query filter params (type=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:23.545513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849242e-ffa7-43e7-9d13-c25734e77774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:23.547144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849242e-ffa7-43e7-9d13-c25734e77774 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:23.562052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 506/1007] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:24.260357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9fb13-915c-4743-a849-b5e476d0e911 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:24.260882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9fb13-915c-4743-a849-b5e476d0e911 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:24.260882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9fb13-915c-4743-a849-b5e476d0e911 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:24.262858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 502/1008] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:24.268009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d777a6-b077-402e-99db-019aa8d2801a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:24.268301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d777a6-b077-402e-99db-019aa8d2801a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:24.268585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d777a6-b077-402e-99db-019aa8d2801a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:24.286218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-37d777a6-b077-402e-99db-019aa8d2801a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:24.287404 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-37d777a6-b077-402e-99db-019aa8d2801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:24.351571 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:24.358020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 507/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:24.638985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9fb13-915c-4743-a849-b5e476d0e911 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:24.677938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1024f6-5536-43ad-a79a-775db3414dbd None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:24.678497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1024f6-5536-43ad-a79a-775db3414dbd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:24.678577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1024f6-5536-43ad-a79a-775db3414dbd None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:24.680010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 508/1010] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:10:24.685396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b4bb-1745-4fe2-98f2-2efda1f0dd71 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:24.685685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b4bb-1745-4fe2-98f2-2efda1f0dd71 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:24.685969 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b4bb-1745-4fe2-98f2-2efda1f0dd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:24.703525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2235b4bb-1745-4fe2-98f2-2efda1f0dd71 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:24.704715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2235b4bb-1745-4fe2-98f2-2efda1f0dd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:24.744124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9fb13-915c-4743-a849-b5e476d0e911 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:24.779349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc04205-44c2-4be9-ba38-7218d6bec544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:24.779970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc04205-44c2-4be9-ba38-7218d6bec544 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:24.780252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc04205-44c2-4be9-ba38-7218d6bec544 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:24.780525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc04205-44c2-4be9-ba38-7218d6bec544 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:24.781644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc04205-44c2-4be9-ba38-7218d6bec544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:24.782330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 509/1011] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:24.783103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc04205-44c2-4be9-ba38-7218d6bec544 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:24.786075 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 503/1012] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:24.790257 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235b4bb-1745-4fe2-98f2-2efda1f0dd71 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:24.889220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235b4bb-1745-4fe2-98f2-2efda1f0dd71 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:24.916954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:24.924163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cef80-c56c-47dd-9c26-95faf510e8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:24.924767 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cef80-c56c-47dd-9c26-95faf510e8e7 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:24.925044 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cef80-c56c-47dd-9c26-95faf510e8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:24.925314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cef80-c56c-47dd-9c26-95faf510e8e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:24.925958 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cef80-c56c-47dd-9c26-95faf510e8e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:24.927396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cef80-c56c-47dd-9c26-95faf510e8e7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:24.956229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 510/1013] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:10:24 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:10:25.044598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc04205-44c2-4be9-ba38-7218d6bec544 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:25.047607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:25.153421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc04205-44c2-4be9-ba38-7218d6bec544 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:25.189388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5a228-e9da-4e82-bec3-18a2179712ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:25.190036 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5a228-e9da-4e82-bec3-18a2179712ee None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:25.190331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5a228-e9da-4e82-bec3-18a2179712ee None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:25.190604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5a228-e9da-4e82-bec3-18a2179712ee None admin] PATH_INFO: `/v3/services/compute` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:25.191189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5a228-e9da-4e82-bec3-18a2179712ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:25.192554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5a228-e9da-4e82-bec3-18a2179712ee None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-1ad5a228-e9da-4e82-bec3-18a2179712ee None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:25.201742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:25.202877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:25.203737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 504/1014] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:25.209002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cef80-c56c-47dd-9c26-95faf510e8e7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:25.314357 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cef80-c56c-47dd-9c26-95faf510e8e7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:25.348941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5a77-2174-4219-9b35-ba288fd27e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:25.349555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5a77-2174-4219-9b35-ba288fd27e24 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:25.349838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5a77-2174-4219-9b35-ba288fd27e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:25.350151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5a77-2174-4219-9b35-ba288fd27e24 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:25.350791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5a77-2174-4219-9b35-ba288fd27e24 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:25.351098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5a77-2174-4219-9b35-ba288fd27e24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:25.352467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5a77-2174-4219-9b35-ba288fd27e24 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:25.358348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 511/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:10:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:25.363778 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5a228-e9da-4e82-bec3-18a2179712ee None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:25.431203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:25.435632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905c7bd-8ca2-4f84-9f93-ebe588623d3b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:25.435917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905c7bd-8ca2-4f84-9f93-ebe588623d3b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:25.436189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905c7bd-8ca2-4f84-9f93-ebe588623d3b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:25.437524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 512/1016] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:25.442502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a271fa-b7f2-4ce2-8143-f80d3eec05d5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:25.442790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a271fa-b7f2-4ce2-8143-f80d3eec05d5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:25.443065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a271fa-b7f2-4ce2-8143-f80d3eec05d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:25.461634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-03a271fa-b7f2-4ce2-8143-f80d3eec05d5 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:25.462840 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-03a271fa-b7f2-4ce2-8143-f80d3eec05d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:25.470388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5a228-e9da-4e82-bec3-18a2179712ee None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:25.504572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:25.507018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e656-d368-4d7e-9386-123e0e488816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:25.507716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e656-d368-4d7e-9386-123e0e488816 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:25.508037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e656-d368-4d7e-9386-123e0e488816 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:25.508329 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628e656-d368-4d7e-9386-123e0e488816 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:25.509041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628e656-d368-4d7e-9386-123e0e488816 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:25.509592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628e656-d368-4d7e-9386-123e0e488816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:25.511656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628e656-d368-4d7e-9386-123e0e488816 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:25.516786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 505/1017] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Aug 19 15:10:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:25.526490 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e656-d368-4d7e-9386-123e0e488816 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:25.532536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 513/1018] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:25.633734 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628e656-d368-4d7e-9386-123e0e488816 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:25.661938 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:25.668643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a3e9e-ae86-4f1a-aa0b-18e5f6983dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:25.669246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a3e9e-ae86-4f1a-aa0b-18e5f6983dac None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:25.669526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a3e9e-ae86-4f1a-aa0b-18e5f6983dac None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:25.669798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a3e9e-ae86-4f1a-aa0b-18e5f6983dac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:25.670494 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a3e9e-ae86-4f1a-aa0b-18e5f6983dac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:25.671850 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a3e9e-ae86-4f1a-aa0b-18e5f6983dac None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:25.691082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 506/1019] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:10:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:10:25.799914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a271fa-b7f2-4ce2-8143-f80d3eec05d5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:25.903451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a271fa-b7f2-4ce2-8143-f80d3eec05d5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:25.943945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86140e-b99a-4d69-b6b0-ae7ce5414355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:25.944477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86140e-b99a-4d69-b6b0-ae7ce5414355 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:25.944752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86140e-b99a-4d69-b6b0-ae7ce5414355 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:25.945023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86140e-b99a-4d69-b6b0-ae7ce5414355 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:25.945660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86140e-b99a-4d69-b6b0-ae7ce5414355 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:25.947055 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86140e-b99a-4d69-b6b0-ae7ce5414355 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:25.962269 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 514/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:10:25 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:10:26.898872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442673-2791-4d38-bcac-0f91f83e23ff None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:26.899362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442673-2791-4d38-bcac-0f91f83e23ff None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:26.899362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1442673-2791-4d38-bcac-0f91f83e23ff None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:26.902261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 507/1021] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:26.906636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ded27-9c07-4592-bfbf-526685005211 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:26.907086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ded27-9c07-4592-bfbf-526685005211 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:26.907195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ded27-9c07-4592-bfbf-526685005211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:26.925033 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-374ded27-9c07-4592-bfbf-526685005211 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:26.926263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-374ded27-9c07-4592-bfbf-526685005211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:26.953166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:27.003924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 515/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:27.273815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1442673-2791-4d38-bcac-0f91f83e23ff None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:27.380690 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1442673-2791-4d38-bcac-0f91f83e23ff None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:27.416139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b25ef-b7c8-4165-8750-3083be56cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:27.416760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b25ef-b7c8-4165-8750-3083be56cb53 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:27.417034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b25ef-b7c8-4165-8750-3083be56cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:27.417820 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b25ef-b7c8-4165-8750-3083be56cb53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:27.418990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b25ef-b7c8-4165-8750-3083be56cb53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:27.420421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b25ef-b7c8-4165-8750-3083be56cb53 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:27.422175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 508/1023] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:27.427645 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ded27-9c07-4592-bfbf-526685005211 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:27.533383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ded27-9c07-4592-bfbf-526685005211 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:27.573368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45424a39-e487-4f5b-b626-e0f8d859c710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:27.574562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45424a39-e487-4f5b-b626-e0f8d859c710 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:27.574847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45424a39-e487-4f5b-b626-e0f8d859c710 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:27.575122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45424a39-e487-4f5b-b626-e0f8d859c710 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:27.575785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45424a39-e487-4f5b-b626-e0f8d859c710 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:27.577209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45424a39-e487-4f5b-b626-e0f8d859c710 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:27.606054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 516/1024] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:10:27 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:10:27.696910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b288c7-cc3e-4db2-b529-93c395240b2f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:27.697247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b288c7-cc3e-4db2-b529-93c395240b2f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:27.697468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b288c7-cc3e-4db2-b529-93c395240b2f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:27.699565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 509/1025] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:27.705145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1981f-28bb-4e7e-aa72-ee7ad1c12ee9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:27.705439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1981f-28bb-4e7e-aa72-ee7ad1c12ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:27.705712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1981f-28bb-4e7e-aa72-ee7ad1c12ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:27.727173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dec1981f-28bb-4e7e-aa72-ee7ad1c12ee9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:27.728398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dec1981f-28bb-4e7e-aa72-ee7ad1c12ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:27.739690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:27.804087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 517/1026] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:27.884914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ed78-046f-46e5-b77e-456d2260bb22 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:27.885233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ed78-046f-46e5-b77e-456d2260bb22 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:27.885469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ed78-046f-46e5-b77e-456d2260bb22 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:27.887508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 510/1027] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:27.892438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b757-8fda-49e3-bab2-225a027424b2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:27.892731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b757-8fda-49e3-bab2-225a027424b2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:27.893012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b757-8fda-49e3-bab2-225a027424b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:27.910751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-61a1b757-8fda-49e3-bab2-225a027424b2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:27.911939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-61a1b757-8fda-49e3-bab2-225a027424b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:27.983263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 518/1028] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:28.071223 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ed78-046f-46e5-b77e-456d2260bb22 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:28.129131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:28.177644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ed78-046f-46e5-b77e-456d2260bb22 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:28.211631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253b278-c44c-4654-811d-3f7bcd93b9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:28.212249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253b278-c44c-4654-811d-3f7bcd93b9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:28.212546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253b278-c44c-4654-811d-3f7bcd93b9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:28.212788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253b278-c44c-4654-811d-3f7bcd93b9b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:28.222861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253b278-c44c-4654-811d-3f7bcd93b9b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5253b278-c44c-4654-811d-3f7bcd93b9b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:28.227471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:28.228370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:28.231133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 511/1029] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 19 15:10:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:28.235678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b757-8fda-49e3-bab2-225a027424b2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:28.250393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253b278-c44c-4654-811d-3f7bcd93b9b5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:28.318249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:28.343216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b757-8fda-49e3-bab2-225a027424b2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:28.364098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253b278-c44c-4654-811d-3f7bcd93b9b5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:28.379483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:28.381952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99194211-b8de-425e-b0f1-bcb0a396fc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:28.382585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194211-b8de-425e-b0f1-bcb0a396fc75 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:28.382923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194211-b8de-425e-b0f1-bcb0a396fc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:28.383136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194211-b8de-425e-b0f1-bcb0a396fc75 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:28.383801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99194211-b8de-425e-b0f1-bcb0a396fc75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:28.384104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99194211-b8de-425e-b0f1-bcb0a396fc75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:28.385466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99194211-b8de-425e-b0f1-bcb0a396fc75 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:28.393949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 519/1030] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 19 15:10:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:28.399285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99194211-b8de-425e-b0f1-bcb0a396fc75 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:28.408826 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34f37f-f662-474a-9c6f-2af754866922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:28.409737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f37f-f662-474a-9c6f-2af754866922 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:28.410257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f37f-f662-474a-9c6f-2af754866922 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:28.411192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f37f-f662-474a-9c6f-2af754866922 None admin] PATH_INFO: `/v3/services/image` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:28.411994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34f37f-f662-474a-9c6f-2af754866922 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:28.414002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34f37f-f662-474a-9c6f-2af754866922 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8f34f37f-f662-474a-9c6f-2af754866922 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:28.426671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:28.427634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:10:28.428467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:28.431022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 512/1031] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Aug 19 15:10:28 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:28.437635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34f37f-f662-474a-9c6f-2af754866922 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:28.523397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99194211-b8de-425e-b0f1-bcb0a396fc75 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:28.538155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34f37f-f662-474a-9c6f-2af754866922 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:28.567948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099958b-d805-482d-afc8-10dc785f2f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:28.568579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099958b-d805-482d-afc8-10dc785f2f52 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:28.568853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099958b-d805-482d-afc8-10dc785f2f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:28.569118 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099958b-d805-482d-afc8-10dc785f2f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:28.571904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:28.574233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9286e6-db55-4414-8f15-3cd5a46ed283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:28.574830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9286e6-db55-4414-8f15-3cd5a46ed283 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:28.575102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9286e6-db55-4414-8f15-3cd5a46ed283 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:28.575371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9286e6-db55-4414-8f15-3cd5a46ed283 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:28.575998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9286e6-db55-4414-8f15-3cd5a46ed283 None admin] RBAC: Adding query filter params (name=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:28.576291 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9286e6-db55-4414-8f15-3cd5a46ed283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:28.577643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9286e6-db55-4414-8f15-3cd5a46ed283 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:28.580686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099958b-d805-482d-afc8-10dc785f2f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:28.582152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0099958b-d805-482d-afc8-10dc785f2f52 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:28.587638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 513/1032] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:28.588344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9286e6-db55-4414-8f15-3cd5a46ed283 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-0099958b-d805-482d-afc8-10dc785f2f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:28.602847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:28.603805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:28.605030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:28.605030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:28.605030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:28.605030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 520/1033] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:28.610620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099958b-d805-482d-afc8-10dc785f2f52 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:28.637236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:28.701942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9286e6-db55-4414-8f15-3cd5a46ed283 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:28.712321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099958b-d805-482d-afc8-10dc785f2f52 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:28.741812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12753974-4bcb-4ce1-82cf-595eef273d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:28.742712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12753974-4bcb-4ce1-82cf-595eef273d71 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:28.743139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12753974-4bcb-4ce1-82cf-595eef273d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:28.743671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12753974-4bcb-4ce1-82cf-595eef273d71 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:28.744476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12753974-4bcb-4ce1-82cf-595eef273d71 None admin] RBAC: Adding query filter params (type=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:28.744783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12753974-4bcb-4ce1-82cf-595eef273d71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:28.746306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12753974-4bcb-4ce1-82cf-595eef273d71 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:28.749430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0d7f4-2301-4136-8474-12e0916f27ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:28.750049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0d7f4-2301-4136-8474-12e0916f27ca None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:28.750338 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0d7f4-2301-4136-8474-12e0916f27ca None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:28.750606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0d7f4-2301-4136-8474-12e0916f27ca None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:28.751240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0d7f4-2301-4136-8474-12e0916f27ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:28.751541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0d7f4-2301-4136-8474-12e0916f27ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:28.752894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0d7f4-2301-4136-8474-12e0916f27ca None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:28.756631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 514/1034] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:28.757526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12753974-4bcb-4ce1-82cf-595eef273d71 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:28.769403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 521/1035] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:28.770385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0d7f4-2301-4136-8474-12e0916f27ca None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:28.821000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:28.873017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0d7f4-2301-4136-8474-12e0916f27ca None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:28.875841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12753974-4bcb-4ce1-82cf-595eef273d71 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:28.883078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:28.908564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b14ca6-97fc-454e-bbfe-d14980ffff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:28.909258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b14ca6-97fc-454e-bbfe-d14980ffff9e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:28.909493 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b14ca6-97fc-454e-bbfe-d14980ffff9e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:28.909763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b14ca6-97fc-454e-bbfe-d14980ffff9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:28.912226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3492d-9dab-47e4-a462-703d6446a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:28.912835 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3492d-9dab-47e4-a462-703d6446a639 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:28.913095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3492d-9dab-47e4-a462-703d6446a639 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:28.913364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3492d-9dab-47e4-a462-703d6446a639 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:28.914081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3492d-9dab-47e4-a462-703d6446a639 None admin] RBAC: Adding query filter params (interface=public, service_id=7da6d8036f524f7f94dee7ad4dbf39f4, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:28.914389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3492d-9dab-47e4-a462-703d6446a639 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:28.915736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3492d-9dab-47e4-a462-703d6446a639 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:28.917059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b14ca6-97fc-454e-bbfe-d14980ffff9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:28.919394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b14ca6-97fc-454e-bbfe-d14980ffff9e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:28.926827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 515/1036] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 19 15:10:28 2022] GET /identity/v3/endpoints?service_id=7da6d8036f524f7f94dee7ad4dbf39f4&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:28.927701 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3492d-9dab-47e4-a462-703d6446a639 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-32b14ca6-97fc-454e-bbfe-d14980ffff9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:10:28.932434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:28.933429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:28.934402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:28.934402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:28.934402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:10:28.934402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:10:28.934402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:10:28.934402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:10:28.934402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:10:28.934402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:10:28.934402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:10:28.934402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:28.938500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 522/1037] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 19 15:10:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:28.939332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b14ca6-97fc-454e-bbfe-d14980ffff9e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:29.034541 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3492d-9dab-47e4-a462-703d6446a639 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:29.043186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b14ca6-97fc-454e-bbfe-d14980ffff9e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:29.051977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:29.074572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb268826-37b9-4964-9095-7ae461d146de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:29.075225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268826-37b9-4964-9095-7ae461d146de None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:29.075454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268826-37b9-4964-9095-7ae461d146de None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:29.075726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb268826-37b9-4964-9095-7ae461d146de None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:29.076341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb268826-37b9-4964-9095-7ae461d146de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:29.077708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb268826-37b9-4964-9095-7ae461d146de None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:29.079785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a4a90-b002-4dfe-83d7-f2dc2f68db70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:29.080618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4a90-b002-4dfe-83d7-f2dc2f68db70 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:29.081062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4a90-b002-4dfe-83d7-f2dc2f68db70 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:29.081486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4a90-b002-4dfe-83d7-f2dc2f68db70 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:29.082546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a4a90-b002-4dfe-83d7-f2dc2f68db70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:29.083002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a4a90-b002-4dfe-83d7-f2dc2f68db70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:29.084316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 516/1038] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 19 15:10:28 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:10:29.084883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a4a90-b002-4dfe-83d7-f2dc2f68db70 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:29.110612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 523/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 19 15:10:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:29.112453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb268826-37b9-4964-9095-7ae461d146de None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:29.151065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:29.224218 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb268826-37b9-4964-9095-7ae461d146de None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:29.259829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c7b77-e9f3-49aa-96d5-1397b87c4e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:29.260453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c7b77-e9f3-49aa-96d5-1397b87c4e14 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:29.260735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c7b77-e9f3-49aa-96d5-1397b87c4e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:29.261568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c7b77-e9f3-49aa-96d5-1397b87c4e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:29.329308 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c7b77-e9f3-49aa-96d5-1397b87c4e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:29.330882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1c7b77-e9f3-49aa-96d5-1397b87c4e14 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:29.362975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:29.428942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 517/1040] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:29 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:10:29.435033 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a4a90-b002-4dfe-83d7-f2dc2f68db70 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:29.540416 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a4a90-b002-4dfe-83d7-f2dc2f68db70 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:29.577298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d13811-7ca3-4759-879a-6fc83c08a67a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:29.577588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d13811-7ca3-4759-879a-6fc83c08a67a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:29.577867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d13811-7ca3-4759-879a-6fc83c08a67a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:29.579360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 518/1041] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:10:29.582097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903a9cf-cee5-44ad-ad83-ff8f91ab8930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:29.582961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903a9cf-cee5-44ad-ad83-ff8f91ab8930 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:29.583244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903a9cf-cee5-44ad-ad83-ff8f91ab8930 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:29.583516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903a9cf-cee5-44ad-ad83-ff8f91ab8930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:29.584029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef54aa-7b9e-4242-9ed8-8cfb11a1949d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:29.584253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef54aa-7b9e-4242-9ed8-8cfb11a1949d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:29.584544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef54aa-7b9e-4242-9ed8-8cfb11a1949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:29.594083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903a9cf-cee5-44ad-ad83-ff8f91ab8930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:29.596930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903a9cf-cee5-44ad-ad83-ff8f91ab8930 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:29.602224 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-63ef54aa-7b9e-4242-9ed8-8cfb11a1949d None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:29.603417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-63ef54aa-7b9e-4242-9ed8-8cfb11a1949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a903a9cf-cee5-44ad-ad83-ff8f91ab8930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:29.612415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:29.613376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:29.614681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:29.614681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:29.614681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:29.614681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 524/1042] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:29.619137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903a9cf-cee5-44ad-ad83-ff8f91ab8930 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:29.640631 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:29.677118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 519/1043] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:29.724337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903a9cf-cee5-44ad-ad83-ff8f91ab8930 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:29.759109 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccd46f-ed33-4204-bb10-ca3bef986fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:29.759721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccd46f-ed33-4204-bb10-ca3bef986fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:29.760006 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccd46f-ed33-4204-bb10-ca3bef986fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:29.760279 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccd46f-ed33-4204-bb10-ca3bef986fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:29.760941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccd46f-ed33-4204-bb10-ca3bef986fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:29.761251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccd46f-ed33-4204-bb10-ca3bef986fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:29.762642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccd46f-ed33-4204-bb10-ca3bef986fb1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:29.774303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 525/1044] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:29.779780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef54aa-7b9e-4242-9ed8-8cfb11a1949d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:29.840240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:29.879375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef54aa-7b9e-4242-9ed8-8cfb11a1949d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:29.912134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd2a1-262f-4e0b-a2b4-03a10528a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:29.912760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd2a1-262f-4e0b-a2b4-03a10528a85a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:29.913048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd2a1-262f-4e0b-a2b4-03a10528a85a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:29.913324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd2a1-262f-4e0b-a2b4-03a10528a85a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:29.920422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fd2a1-262f-4e0b-a2b4-03a10528a85a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:29.921855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fd2a1-262f-4e0b-a2b4-03a10528a85a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-710fd2a1-262f-4e0b-a2b4-03a10528a85a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:10:29.932715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:29.934474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:29.935383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:10:29.935383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:10:29.935383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:10:29.935383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:10:29.935383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:10:29.935383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:10:29.935383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:29.935383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:29.938339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 520/1045] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:29.940109 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccd46f-ed33-4204-bb10-ca3bef986fb1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:29.943029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd2a1-262f-4e0b-a2b4-03a10528a85a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:30.019937 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:30.043068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccd46f-ed33-4204-bb10-ca3bef986fb1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:30.054279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd2a1-262f-4e0b-a2b4-03a10528a85a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:30.077885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:30.082297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc015401-a58c-4cea-8806-3db1a0c661d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:30.082912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc015401-a58c-4cea-8806-3db1a0c661d4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:30.083197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc015401-a58c-4cea-8806-3db1a0c661d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:30.083470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc015401-a58c-4cea-8806-3db1a0c661d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:30.084170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc015401-a58c-4cea-8806-3db1a0c661d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:30.084481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc015401-a58c-4cea-8806-3db1a0c661d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:30.085905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc015401-a58c-4cea-8806-3db1a0c661d4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:30.090615 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaef47-30c4-4eed-b8e4-edb89196e21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:30.091239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaef47-30c4-4eed-b8e4-edb89196e21e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:30.091514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaef47-30c4-4eed-b8e4-edb89196e21e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:30.091783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaef47-30c4-4eed-b8e4-edb89196e21e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:30.098167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 526/1046] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:10:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:30.104273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc015401-a58c-4cea-8806-3db1a0c661d4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:30.110361 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaef47-30c4-4eed-b8e4-edb89196e21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4aaaef47-30c4-4eed-b8e4-edb89196e21e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:30.115085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:30.115996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:30.116838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 521/1047] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:10:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:30.121994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaef47-30c4-4eed-b8e4-edb89196e21e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:30.215358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc015401-a58c-4cea-8806-3db1a0c661d4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:30.225402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaef47-30c4-4eed-b8e4-edb89196e21e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:30.251522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d917ed2-8ec2-4d3a-b8cc-1455f8ff48ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:30.252120 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d917ed2-8ec2-4d3a-b8cc-1455f8ff48ef None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:30.252400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d917ed2-8ec2-4d3a-b8cc-1455f8ff48ef None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:30.252674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d917ed2-8ec2-4d3a-b8cc-1455f8ff48ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:30.253384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d917ed2-8ec2-4d3a-b8cc-1455f8ff48ef None admin] RBAC: Adding query filter params (role.id=ffe0dfc406a649efb1b01761d344839a, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=a86ca59cbf894c508b3439b08715da86) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:30.253687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d917ed2-8ec2-4d3a-b8cc-1455f8ff48ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:30.255186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d917ed2-8ec2-4d3a-b8cc-1455f8ff48ef None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:30.260867 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 527/1048] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:30 2022] GET /identity/v3/role_assignments?user.id=a86ca59cbf894c508b3439b08715da86&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=ffe0dfc406a649efb1b01761d344839a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:30.262405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc65dd4-3b5f-4b6d-aa99-5e5922e93e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:30.263174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc65dd4-3b5f-4b6d-aa99-5e5922e93e26 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:30.263596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc65dd4-3b5f-4b6d-aa99-5e5922e93e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:30.264011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc65dd4-3b5f-4b6d-aa99-5e5922e93e26 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:30.264839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc65dd4-3b5f-4b6d-aa99-5e5922e93e26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:30.265288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc65dd4-3b5f-4b6d-aa99-5e5922e93e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:30.266894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc65dd4-3b5f-4b6d-aa99-5e5922e93e26 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:30.277806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 522/1049] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:10:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:30.283475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d917ed2-8ec2-4d3a-b8cc-1455f8ff48ef None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:30.286815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:30.394548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d917ed2-8ec2-4d3a-b8cc-1455f8ff48ef None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:30.429814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c5674-1295-4523-9410-c4a3a5e793f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:30.430468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c5674-1295-4523-9410-c4a3a5e793f6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:30.430744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c5674-1295-4523-9410-c4a3a5e793f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:30.431013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c5674-1295-4523-9410-c4a3a5e793f6 None admin] PATH_INFO: `/v3/users/e02c46895492497abfdf3025f101715d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:30.444733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c5674-1295-4523-9410-c4a3a5e793f6 None admin] RBAC: Authorizing `identity:get_user(user_id=e02c46895492497abfdf3025f101715d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:30.446200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c5674-1295-4523-9410-c4a3a5e793f6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:30.453040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 528/1050] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:10:30 2022] GET /identity/v3/users/e02c46895492497abfdf3025f101715d => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:30.454230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc65dd4-3b5f-4b6d-aa99-5e5922e93e26 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:30.502392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:30.565426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc65dd4-3b5f-4b6d-aa99-5e5922e93e26 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:30.600760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa68b93-d677-43d1-8817-8e0e031bd3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:30.601362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68b93-d677-43d1-8817-8e0e031bd3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:30.601638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68b93-d677-43d1-8817-8e0e031bd3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:30.601900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68b93-d677-43d1-8817-8e0e031bd3d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:30.669577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa68b93-d677-43d1-8817-8e0e031bd3d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:30.671037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa68b93-d677-43d1-8817-8e0e031bd3d5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:30.717529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:30.772710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 523/1051] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:10:30.778981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c5674-1295-4523-9410-c4a3a5e793f6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:30.838118 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:30.879837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c5674-1295-4523-9410-c4a3a5e793f6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:30.913392 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d700168-0150-4b24-b50c-da5219bebe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:30.914015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d700168-0150-4b24-b50c-da5219bebe14 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:30.914315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d700168-0150-4b24-b50c-da5219bebe14 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:30.914581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d700168-0150-4b24-b50c-da5219bebe14 None admin] PATH_INFO: `/v3/projects/1feabb3def254167851693a5df14463f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:30.915681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d700168-0150-4b24-b50c-da5219bebe14 None admin] RBAC: Authorizing `identity:get_project(project_id=1feabb3def254167851693a5df14463f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:30.917097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d700168-0150-4b24-b50c-da5219bebe14 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:30.918957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 529/1052] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:10:30 2022] GET /identity/v3/projects/1feabb3def254167851693a5df14463f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:30.924964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa68b93-d677-43d1-8817-8e0e031bd3d5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:31.021642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7843a6e-5aed-43bb-85d1-2883cb849f85 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:31.022210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7843a6e-5aed-43bb-85d1-2883cb849f85 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:31.022210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7843a6e-5aed-43bb-85d1-2883cb849f85 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:31.022513 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa68b93-d677-43d1-8817-8e0e031bd3d5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:31.023650 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 530/1053] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:10:31.028320 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3b21-1f02-4c9c-9e3e-4e63f94f34f2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:31.028605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3b21-1f02-4c9c-9e3e-4e63f94f34f2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:31.028882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a3b21-1f02-4c9c-9e3e-4e63f94f34f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:31.046283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0c0a3b21-1f02-4c9c-9e3e-4e63f94f34f2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:31.047474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0c0a3b21-1f02-4c9c-9e3e-4e63f94f34f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:31.057415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e4818-3f35-43f2-8b20-b2d3da9c53ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:31.058804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e4818-3f35-43f2-8b20-b2d3da9c53ab None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:31.059232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e4818-3f35-43f2-8b20-b2d3da9c53ab None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:31.059652 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e4818-3f35-43f2-8b20-b2d3da9c53ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:31.060654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e4818-3f35-43f2-8b20-b2d3da9c53ab None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=1feabb3def254167851693a5df14463f, user.id=e02c46895492497abfdf3025f101715d) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:31.061111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e4818-3f35-43f2-8b20-b2d3da9c53ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:31.062773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e4818-3f35-43f2-8b20-b2d3da9c53ab None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:31.068616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 524/1054] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:30 2022] GET /identity/v3/role_assignments?user.id=e02c46895492497abfdf3025f101715d&scope.project.id=1feabb3def254167851693a5df14463f&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:31.126611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 531/1055] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:31.399091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e4818-3f35-43f2-8b20-b2d3da9c53ab None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:31.411842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:31.503605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e4818-3f35-43f2-8b20-b2d3da9c53ab None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:31.539784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54d17b-f71e-4b52-90e6-28216c1e1ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:31.540415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54d17b-f71e-4b52-90e6-28216c1e1ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:31.540691 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54d17b-f71e-4b52-90e6-28216c1e1ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:31.540960 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54d17b-f71e-4b52-90e6-28216c1e1ec3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:31.541540 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54d17b-f71e-4b52-90e6-28216c1e1ec3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:31.543440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54d17b-f71e-4b52-90e6-28216c1e1ec3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bd54d17b-f71e-4b52-90e6-28216c1e1ec3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:31.553413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:31.554451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 15:10:31.555303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:31.559011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 525/1056] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Aug 19 15:10:31 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:31.561086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a3b21-1f02-4c9c-9e3e-4e63f94f34f2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:31.626502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:31.669447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a3b21-1f02-4c9c-9e3e-4e63f94f34f2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:31.702478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29bb91-9008-441d-a7e1-205aadffe417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:31.703086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29bb91-9008-441d-a7e1-205aadffe417 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:31.703372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29bb91-9008-441d-a7e1-205aadffe417 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:31.703646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29bb91-9008-441d-a7e1-205aadffe417 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:31.704277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29bb91-9008-441d-a7e1-205aadffe417 None admin] RBAC: Adding query filter params (name=image) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:31.704579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29bb91-9008-441d-a7e1-205aadffe417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:31.705939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29bb91-9008-441d-a7e1-205aadffe417 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:31.716019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 532/1057] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:31.717240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54d17b-f71e-4b52-90e6-28216c1e1ec3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:31.794819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:31.820601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54d17b-f71e-4b52-90e6-28216c1e1ec3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:31.854390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e203e5-1de8-487d-97b3-97aee2c12528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:31.855528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e203e5-1de8-487d-97b3-97aee2c12528 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:31.855803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e203e5-1de8-487d-97b3-97aee2c12528 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:31.856072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e203e5-1de8-487d-97b3-97aee2c12528 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:31.856698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e203e5-1de8-487d-97b3-97aee2c12528 None admin] RBAC: Adding query filter params (type=image) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:31.856999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e203e5-1de8-487d-97b3-97aee2c12528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:31.858373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e203e5-1de8-487d-97b3-97aee2c12528 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:31.867648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 526/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:31.869143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29bb91-9008-441d-a7e1-205aadffe417 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:31.969530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29bb91-9008-441d-a7e1-205aadffe417 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:31.991397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:32.004192 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe30e-652f-41ce-8f27-08c2b6005529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:32.004806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe30e-652f-41ce-8f27-08c2b6005529 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:32.005089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe30e-652f-41ce-8f27-08c2b6005529 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:32.005363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe30e-652f-41ce-8f27-08c2b6005529 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:32.006055 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe30e-652f-41ce-8f27-08c2b6005529 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:32.007429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe30e-652f-41ce-8f27-08c2b6005529 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:32.034060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 533/1059] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:10:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:10:32.147588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61790da-2cbd-4179-9d86-bf3c0b458528 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:32.147950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61790da-2cbd-4179-9d86-bf3c0b458528 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:32.148153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61790da-2cbd-4179-9d86-bf3c0b458528 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:32.149670 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 527/1060] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:32.155640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efbd09-0683-4d2e-a0f6-5d94fc545b49 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:32.155939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efbd09-0683-4d2e-a0f6-5d94fc545b49 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:32.156237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efbd09-0683-4d2e-a0f6-5d94fc545b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:32.174388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-85efbd09-0683-4d2e-a0f6-5d94fc545b49 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:32.175593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-85efbd09-0683-4d2e-a0f6-5d94fc545b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:32.251600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 534/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:32.516044 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61790da-2cbd-4179-9d86-bf3c0b458528 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:32.624402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61790da-2cbd-4179-9d86-bf3c0b458528 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:32.657916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e44ad-4066-40b1-b25b-40069c9b0cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:32.658568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e44ad-4066-40b1-b25b-40069c9b0cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:32.658849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e44ad-4066-40b1-b25b-40069c9b0cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:32.659120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e44ad-4066-40b1-b25b-40069c9b0cc0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:32.665807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:32.671198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e44ad-4066-40b1-b25b-40069c9b0cc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-bf2e44ad-4066-40b1-b25b-40069c9b0cc0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:32.676411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:32.677335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:32.678203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:32.682098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 528/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 19 15:10:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:32.684288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efbd09-0683-4d2e-a0f6-5d94fc545b49 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:32.780998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efbd09-0683-4d2e-a0f6-5d94fc545b49 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:32.783227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:32.817454 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fcacf-54f6-4de3-b2f4-cfb39388a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:32.818085 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fcacf-54f6-4de3-b2f4-cfb39388a5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:32.818369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fcacf-54f6-4de3-b2f4-cfb39388a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:32.818643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fcacf-54f6-4de3-b2f4-cfb39388a5c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:32.819303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fcacf-54f6-4de3-b2f4-cfb39388a5c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:32.819609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fcacf-54f6-4de3-b2f4-cfb39388a5c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:32.820964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fcacf-54f6-4de3-b2f4-cfb39388a5c4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:32.833476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 535/1063] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 19 15:10:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:32.834719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e44ad-4066-40b1-b25b-40069c9b0cc0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:32.937394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e44ad-4066-40b1-b25b-40069c9b0cc0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:32.942348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8b037-8abe-4dd3-bb0e-69b1ded87c9e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:32.942637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8b037-8abe-4dd3-bb0e-69b1ded87c9e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:32.942914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8b037-8abe-4dd3-bb0e-69b1ded87c9e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:32.944383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 536/1064] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:10:32.948982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edea3d-c4f0-4553-8d82-a978c473fba1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:32.949269 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edea3d-c4f0-4553-8d82-a978c473fba1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:32.949549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edea3d-c4f0-4553-8d82-a978c473fba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:32.967653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-12edea3d-c4f0-4553-8d82-a978c473fba1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:32.968822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-12edea3d-c4f0-4553-8d82-a978c473fba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:32.975645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6d02-1972-4c94-a13f-c2d6de28326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:32.976276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6d02-1972-4c94-a13f-c2d6de28326e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:32.976555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6d02-1972-4c94-a13f-c2d6de28326e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:32.976832 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6d02-1972-4c94-a13f-c2d6de28326e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:32.988797 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc6d02-1972-4c94-a13f-c2d6de28326e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:32.990259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc6d02-1972-4c94-a13f-c2d6de28326e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e9bc6d02-1972-4c94-a13f-c2d6de28326e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:33.005547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:33.010875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:33.011891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:33.011891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:33.011891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:33.011891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 529/1065] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:33.013162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6d02-1972-4c94-a13f-c2d6de28326e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:33.045862 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 537/1066] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:33.069757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:33.120642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6d02-1972-4c94-a13f-c2d6de28326e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:33.155537 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb30eb-3b28-4fd5-bbbd-5ab79d52ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:33.156135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb30eb-3b28-4fd5-bbbd-5ab79d52ed1c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:33.156411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb30eb-3b28-4fd5-bbbd-5ab79d52ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:33.156676 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb30eb-3b28-4fd5-bbbd-5ab79d52ed1c None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:33.157307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb30eb-3b28-4fd5-bbbd-5ab79d52ed1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:33.157600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb30eb-3b28-4fd5-bbbd-5ab79d52ed1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:33.159007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb30eb-3b28-4fd5-bbbd-5ab79d52ed1c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:33.171433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 530/1067] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:33.176818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edea3d-c4f0-4553-8d82-a978c473fba1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:33.268323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:33.275224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edea3d-c4f0-4553-8d82-a978c473fba1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:33.307648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5179f-4292-414b-9b16-f12a9ada4dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:33.308727 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5179f-4292-414b-9b16-f12a9ada4dee None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:33.309003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5179f-4292-414b-9b16-f12a9ada4dee None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:33.309294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5179f-4292-414b-9b16-f12a9ada4dee None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:33.316017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb30eb-3b28-4fd5-bbbd-5ab79d52ed1c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:33.316223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5179f-4292-414b-9b16-f12a9ada4dee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:33.317628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5179f-4292-414b-9b16-f12a9ada4dee None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5df5179f-4292-414b-9b16-f12a9ada4dee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:10:33.330147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:33.331152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:33.332090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:33.332090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:33.332090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:10:33.332090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:10:33.332090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:10:33.332090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:10:33.332090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:10:33.332090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:10:33.332090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:10:33.332090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:33.335895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 538/1068] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 19 15:10:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:33.336679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5179f-4292-414b-9b16-f12a9ada4dee None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:33.426848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb30eb-3b28-4fd5-bbbd-5ab79d52ed1c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:33.437970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:33.445313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5179f-4292-414b-9b16-f12a9ada4dee None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:33.462673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecea471-f979-4119-81c3-c516341783d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:33.463265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecea471-f979-4119-81c3-c516341783d9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:33.463543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecea471-f979-4119-81c3-c516341783d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:33.463813 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecea471-f979-4119-81c3-c516341783d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:33.474358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecea471-f979-4119-81c3-c516341783d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-eecea471-f979-4119-81c3-c516341783d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:33.479236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:33.480424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:33.481672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 531/1069] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:10:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:33.484181 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24950ae-f511-4a83-aca5-4535e42b94a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:33.484856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24950ae-f511-4a83-aca5-4535e42b94a6 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:33.485209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24950ae-f511-4a83-aca5-4535e42b94a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:33.485591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24950ae-f511-4a83-aca5-4535e42b94a6 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:33.486274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecea471-f979-4119-81c3-c516341783d9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:33.486472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24950ae-f511-4a83-aca5-4535e42b94a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:33.486849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24950ae-f511-4a83-aca5-4535e42b94a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:33.488333 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24950ae-f511-4a83-aca5-4535e42b94a6 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:33.505971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 539/1070] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 19 15:10:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:33.513472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24950ae-f511-4a83-aca5-4535e42b94a6 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:33.533122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:33.600851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecea471-f979-4119-81c3-c516341783d9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:33.625225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24950ae-f511-4a83-aca5-4535e42b94a6 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:33.639365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfcd8a-bc22-40b5-8496-d16db7dbc187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:33.640089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfcd8a-bc22-40b5-8496-d16db7dbc187 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:33.640483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfcd8a-bc22-40b5-8496-d16db7dbc187 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:33.640849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfcd8a-bc22-40b5-8496-d16db7dbc187 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:33.641605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfcd8a-bc22-40b5-8496-d16db7dbc187 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:33.641999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfcd8a-bc22-40b5-8496-d16db7dbc187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:33.643468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcfcd8a-bc22-40b5-8496-d16db7dbc187 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:33.653314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 532/1071] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:10:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:33.658838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfcd8a-bc22-40b5-8496-d16db7dbc187 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:33.662121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f68be1-a20a-42ef-8958-ce353cb70448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:33.662847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f68be1-a20a-42ef-8958-ce353cb70448 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:33.663189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f68be1-a20a-42ef-8958-ce353cb70448 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:33.663470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f68be1-a20a-42ef-8958-ce353cb70448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:33.674195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f68be1-a20a-42ef-8958-ce353cb70448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:33.675627 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f68be1-a20a-42ef-8958-ce353cb70448 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-44f68be1-a20a-42ef-8958-ce353cb70448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:33.690020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:33.690981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:33.692720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:33.692720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:33.692720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:33.692720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 540/1072] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:33.693598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:33.696815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f68be1-a20a-42ef-8958-ce353cb70448 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:33.766088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:33.770948 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfcd8a-bc22-40b5-8496-d16db7dbc187 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:33.805249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f68be1-a20a-42ef-8958-ce353cb70448 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:33.806199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c6c0-5372-4ad1-ace7-f52413ef6f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:33.806829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c6c0-5372-4ad1-ace7-f52413ef6f9f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:33.807110 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c6c0-5372-4ad1-ace7-f52413ef6f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:33.807385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c6c0-5372-4ad1-ace7-f52413ef6f9f None admin] PATH_INFO: `/v3/users/e02c46895492497abfdf3025f101715d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:33.809072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890c6c0-5372-4ad1-ace7-f52413ef6f9f None admin] RBAC: Authorizing `identity:get_user(user_id=e02c46895492497abfdf3025f101715d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:33.810589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890c6c0-5372-4ad1-ace7-f52413ef6f9f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:33.816955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 533/1073] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:10:33 2022] GET /identity/v3/users/e02c46895492497abfdf3025f101715d => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:33.817750 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c6c0-5372-4ad1-ace7-f52413ef6f9f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:33.844701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c936d35-93f6-42e2-a0f2-0f58632568bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:33.845286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c936d35-93f6-42e2-a0f2-0f58632568bb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:33.845563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c936d35-93f6-42e2-a0f2-0f58632568bb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:33.845831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c936d35-93f6-42e2-a0f2-0f58632568bb None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:33.846490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c936d35-93f6-42e2-a0f2-0f58632568bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:33.846789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c936d35-93f6-42e2-a0f2-0f58632568bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:33.848145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c936d35-93f6-42e2-a0f2-0f58632568bb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:33.860369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 541/1074] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:33.865639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c936d35-93f6-42e2-a0f2-0f58632568bb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:33.925770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:33.929529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c6c0-5372-4ad1-ace7-f52413ef6f9f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:33.965918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c936d35-93f6-42e2-a0f2-0f58632568bb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:33.968643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31d51c-1e52-4ae1-9c75-85a39c98d431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:33.969306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31d51c-1e52-4ae1-9c75-85a39c98d431 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:33.969582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31d51c-1e52-4ae1-9c75-85a39c98d431 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:33.969859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31d51c-1e52-4ae1-9c75-85a39c98d431 None admin] PATH_INFO: `/v3/projects/1feabb3def254167851693a5df14463f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:33.971011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31d51c-1e52-4ae1-9c75-85a39c98d431 None admin] RBAC: Authorizing `identity:get_project(project_id=1feabb3def254167851693a5df14463f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:33.972620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31d51c-1e52-4ae1-9c75-85a39c98d431 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:33.974304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 534/1075] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:10:33 2022] GET /identity/v3/projects/1feabb3def254167851693a5df14463f => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:33.975555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bbfc-a783-48b5-9a9d-47afed74d8b3 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:33.975847 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bbfc-a783-48b5-9a9d-47afed74d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:33.976124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93bbfc-a783-48b5-9a9d-47afed74d8b3 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:33.977406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 535/1076] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:33.980305 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93bbfc-a783-48b5-9a9d-47afed74d8b3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:33.992103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:34.002022 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc931d97-94bd-466a-b05c-018c551c4f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:34.002675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc931d97-94bd-466a-b05c-018c551c4f3a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:34.002958 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc931d97-94bd-466a-b05c-018c551c4f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:34.003234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc931d97-94bd-466a-b05c-018c551c4f3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:34.009786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc931d97-94bd-466a-b05c-018c551c4f3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:34.011831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc931d97-94bd-466a-b05c-018c551c4f3a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-fc931d97-94bd-466a-b05c-018c551c4f3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:10:34.022652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:34.023541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:34.024481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:10:34.024481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:10:34.024481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:10:34.024481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:10:34.024481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:10:34.024481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:10:34.024481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:34.024481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:34.024481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 542/1077] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:34.025230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e377-68d7-4686-8008-6ec6a4d0108b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:34.025540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e377-68d7-4686-8008-6ec6a4d0108b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:34.025751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e377-68d7-4686-8008-6ec6a4d0108b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:34.043830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ed20e377-68d7-4686-8008-6ec6a4d0108b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:34.045020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ed20e377-68d7-4686-8008-6ec6a4d0108b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:34.084240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93bbfc-a783-48b5-9a9d-47afed74d8b3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:34.110763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 543/1078] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:34.111507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20e377-68d7-4686-8008-6ec6a4d0108b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:34.123305 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e451-ab5a-4701-bfcc-881e7f0616da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:34.123981 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e451-ab5a-4701-bfcc-881e7f0616da None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:34.124238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e451-ab5a-4701-bfcc-881e7f0616da None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:34.124510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e451-ab5a-4701-bfcc-881e7f0616da None admin] PATH_INFO: `/v3/projects/1feabb3def254167851693a5df14463f/users/e02c46895492497abfdf3025f101715d/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:34.126429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431e451-ab5a-4701-bfcc-881e7f0616da None admin] RBAC: Authorizing `identity:create_grant(project_id=1feabb3def254167851693a5df14463f, user_id=e02c46895492497abfdf3025f101715d, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:34.127838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431e451-ab5a-4701-bfcc-881e7f0616da None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:34.142089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 536/1079] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:10:33 2022] PUT /identity/v3/projects/1feabb3def254167851693a5df14463f/users/e02c46895492497abfdf3025f101715d/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:10:34.229789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20e377-68d7-4686-8008-6ec6a4d0108b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:34.247301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:34.267610 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433ebd5-9ac3-416e-b045-1c0a7395e9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:34.268234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433ebd5-9ac3-416e-b045-1c0a7395e9ae None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:34.268512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433ebd5-9ac3-416e-b045-1c0a7395e9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:34.268779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433ebd5-9ac3-416e-b045-1c0a7395e9ae None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:34.269473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433ebd5-9ac3-416e-b045-1c0a7395e9ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:34.269779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433ebd5-9ac3-416e-b045-1c0a7395e9ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:34.271241 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433ebd5-9ac3-416e-b045-1c0a7395e9ae None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:34.284620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 544/1080] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:10:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:34.290761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e451-ab5a-4701-bfcc-881e7f0616da None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:34.325490 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:34.387285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433ebd5-9ac3-416e-b045-1c0a7395e9ae None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:34.403510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e451-ab5a-4701-bfcc-881e7f0616da None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:34.438737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4b346-a22a-4b5c-ae4a-932a9c8ea4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:34.439402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b346-a22a-4b5c-ae4a-932a9c8ea4c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:34.439684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b346-a22a-4b5c-ae4a-932a9c8ea4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:34.439961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b346-a22a-4b5c-ae4a-932a9c8ea4c9 None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/a86ca59cbf894c508b3439b08715da86/roles/ffe0dfc406a649efb1b01761d344839a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:34.442165 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4b346-a22a-4b5c-ae4a-932a9c8ea4c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=a86ca59cbf894c508b3439b08715da86, role_id=ffe0dfc406a649efb1b01761d344839a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:34.443594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4b346-a22a-4b5c-ae4a-932a9c8ea4c9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:34.457135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 537/1081] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:10:34 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/a86ca59cbf894c508b3439b08715da86/roles/ffe0dfc406a649efb1b01761d344839a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:10:34.507242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433ebd5-9ac3-416e-b045-1c0a7395e9ae None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:34.553860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5d110-95b0-4dd2-aa0f-e252c0f11b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:34.554523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5d110-95b0-4dd2-aa0f-e252c0f11b29 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:34.555290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5d110-95b0-4dd2-aa0f-e252c0f11b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:34.555290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5d110-95b0-4dd2-aa0f-e252c0f11b29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:34.612798 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:34.638156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5d110-95b0-4dd2-aa0f-e252c0f11b29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:34.639529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5d110-95b0-4dd2-aa0f-e252c0f11b29 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:34.742054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 545/1082] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 15:10:34.744972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4b346-a22a-4b5c-ae4a-932a9c8ea4c9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:34.832802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:34.847543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4b346-a22a-4b5c-ae4a-932a9c8ea4c9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:34.880854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6076f-12a7-48b1-8c5f-b827a32a2916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:34.881478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6076f-12a7-48b1-8c5f-b827a32a2916 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:34.881754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6076f-12a7-48b1-8c5f-b827a32a2916 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:34.882020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6076f-12a7-48b1-8c5f-b827a32a2916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:34.892384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6076f-12a7-48b1-8c5f-b827a32a2916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:34.893751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6076f-12a7-48b1-8c5f-b827a32a2916 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8cf6076f-12a7-48b1-8c5f-b827a32a2916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:34.908716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:34.909663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:34.910914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:34.910914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:34.910914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:34.914331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 538/1083] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:34.915674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5d110-95b0-4dd2-aa0f-e252c0f11b29 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:34.993216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:35.017615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5d110-95b0-4dd2-aa0f-e252c0f11b29 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:35.050866 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a98b9c-262b-4113-8d42-c171902b1d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:35.051470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98b9c-262b-4113-8d42-c171902b1d92 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:35.051745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98b9c-262b-4113-8d42-c171902b1d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:35.052012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98b9c-262b-4113-8d42-c171902b1d92 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:35.052648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a98b9c-262b-4113-8d42-c171902b1d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:35.052945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a98b9c-262b-4113-8d42-c171902b1d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:35.054310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a98b9c-262b-4113-8d42-c171902b1d92 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:35.074061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 546/1084] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:36.052895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed05bb-7574-4782-bcd4-f951863d465f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:36.053420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed05bb-7574-4782-bcd4-f951863d465f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:36.053420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed05bb-7574-4782-bcd4-f951863d465f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:36.054771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 539/1085] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:36.060577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6205b1-7eac-4443-90aa-bc00c52e2ef3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:36.060977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6205b1-7eac-4443-90aa-bc00c52e2ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:36.061122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6205b1-7eac-4443-90aa-bc00c52e2ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:36.078659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8a6205b1-7eac-4443-90aa-bc00c52e2ef3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:36.079834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8a6205b1-7eac-4443-90aa-bc00c52e2ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:36.143615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 547/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:36.357232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f48f24-7827-4ab3-8b6e-b54a0547cee4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:36.357534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f48f24-7827-4ab3-8b6e-b54a0547cee4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:36.357873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f48f24-7827-4ab3-8b6e-b54a0547cee4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:36.359284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 540/1087] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:36.364398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3d0af-456e-4fdc-8d85-6f0ce2acf022 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:36.364852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3d0af-456e-4fdc-8d85-6f0ce2acf022 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:36.365132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3d0af-456e-4fdc-8d85-6f0ce2acf022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:36.382675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6ac3d0af-456e-4fdc-8d85-6f0ce2acf022 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:36.383858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6ac3d0af-456e-4fdc-8d85-6f0ce2acf022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:36.405560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f48f24-7827-4ab3-8b6e-b54a0547cee4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:36.442014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:36.450295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 548/1088] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:36.504923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f48f24-7827-4ab3-8b6e-b54a0547cee4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:36.538574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd90c0-12f1-4c0c-bae8-a3e7cf114ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:36.539205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd90c0-12f1-4c0c-bae8-a3e7cf114ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:36.539483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd90c0-12f1-4c0c-bae8-a3e7cf114ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:36.539760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd90c0-12f1-4c0c-bae8-a3e7cf114ea7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:36.547274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:36.552025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd90c0-12f1-4c0c-bae8-a3e7cf114ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-14bd90c0-12f1-4c0c-bae8-a3e7cf114ea7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:36.555790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:36.556903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:36.558082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 541/1089] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:10:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:36.563005 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3d0af-456e-4fdc-8d85-6f0ce2acf022 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:36.659177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3d0af-456e-4fdc-8d85-6f0ce2acf022 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:36.692198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ae6d9-e4bf-47e0-acbf-60a79f5e6052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:36.692795 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ae6d9-e4bf-47e0-acbf-60a79f5e6052 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:36.693070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ae6d9-e4bf-47e0-acbf-60a79f5e6052 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:36.693339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ae6d9-e4bf-47e0-acbf-60a79f5e6052 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:36.693994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ae6d9-e4bf-47e0-acbf-60a79f5e6052 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:36.694329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ae6d9-e4bf-47e0-acbf-60a79f5e6052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:36.695677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ae6d9-e4bf-47e0-acbf-60a79f5e6052 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:36.703845 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 549/1090] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:10:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:36.709589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd90c0-12f1-4c0c-bae8-a3e7cf114ea7 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:36.724050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ae6d9-e4bf-47e0-acbf-60a79f5e6052 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:36.780861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:36.810638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd90c0-12f1-4c0c-bae8-a3e7cf114ea7 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:36.822288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ae6d9-e4bf-47e0-acbf-60a79f5e6052 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:36.843854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb260e47-40ab-4549-a727-a27aa31d530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:36.844480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb260e47-40ab-4549-a727-a27aa31d530c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:36.844759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb260e47-40ab-4549-a727-a27aa31d530c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:36.845117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb260e47-40ab-4549-a727-a27aa31d530c None admin] PATH_INFO: `/v3/users/e02c46895492497abfdf3025f101715d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:36.846270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb260e47-40ab-4549-a727-a27aa31d530c None admin] RBAC: Authorizing `identity:get_user(user_id=e02c46895492497abfdf3025f101715d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:36.847705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb260e47-40ab-4549-a727-a27aa31d530c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:36.849261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 542/1091] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:10:36 2022] GET /identity/v3/users/e02c46895492497abfdf3025f101715d => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:36.855841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb260e47-40ab-4549-a727-a27aa31d530c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:36.860262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3a64-3625-4002-933f-2210d6be39af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:36.860890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3a64-3625-4002-933f-2210d6be39af None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:36.861172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3a64-3625-4002-933f-2210d6be39af None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:36.861447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3a64-3625-4002-933f-2210d6be39af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:36.872989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed3a64-3625-4002-933f-2210d6be39af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-baed3a64-3625-4002-933f-2210d6be39af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:36.877679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:36.878776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:36.879779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 550/1092] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Aug 19 15:10:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:36.884565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3a64-3625-4002-933f-2210d6be39af None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:36.922903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:36.956836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb260e47-40ab-4549-a727-a27aa31d530c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:36.981530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3a64-3625-4002-933f-2210d6be39af None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:36.990207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9360468-86ac-4509-883f-f96889d1bb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:36.990802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9360468-86ac-4509-883f-f96889d1bb3e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:36.991078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9360468-86ac-4509-883f-f96889d1bb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:36.991346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9360468-86ac-4509-883f-f96889d1bb3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:36.998398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:37.015292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2535e-5522-4a8f-b3b3-ad7a6464c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:37.015890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2535e-5522-4a8f-b3b3-ad7a6464c53d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:37.016173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2535e-5522-4a8f-b3b3-ad7a6464c53d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:37.016451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2535e-5522-4a8f-b3b3-ad7a6464c53d None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:37.017103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2535e-5522-4a8f-b3b3-ad7a6464c53d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:37.017409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2535e-5522-4a8f-b3b3-ad7a6464c53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:37.018801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2535e-5522-4a8f-b3b3-ad7a6464c53d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:37.027432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 551/1093] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 19 15:10:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:37.033073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2535e-5522-4a8f-b3b3-ad7a6464c53d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:37.058865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9360468-86ac-4509-883f-f96889d1bb3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:37.060298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9360468-86ac-4509-883f-f96889d1bb3e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:37.123015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:37.130235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2535e-5522-4a8f-b3b3-ad7a6464c53d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:37.162129 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 543/1094] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 15:10:37.168292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22f912-ddac-472a-88e6-41c0e68f3cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:37.168465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9360468-86ac-4509-883f-f96889d1bb3e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:37.168919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f912-ddac-472a-88e6-41c0e68f3cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:37.169198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f912-ddac-472a-88e6-41c0e68f3cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:37.169471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22f912-ddac-472a-88e6-41c0e68f3cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:37.179691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22f912-ddac-472a-88e6-41c0e68f3cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:37.181083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22f912-ddac-472a-88e6-41c0e68f3cd1 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2c22f912-ddac-472a-88e6-41c0e68f3cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:37.195910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:37.196855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:37.198019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:37.198019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:37.198019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:37.198019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 552/1095] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:37.202794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22f912-ddac-472a-88e6-41c0e68f3cd1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:37.234795 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:37.268856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9360468-86ac-4509-883f-f96889d1bb3e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:37.301740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9cae-8457-4656-8534-d62baec9639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:37.301984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22f912-ddac-472a-88e6-41c0e68f3cd1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:37.302398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9cae-8457-4656-8534-d62baec9639f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:37.302672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9cae-8457-4656-8534-d62baec9639f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:37.302939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9cae-8457-4656-8534-d62baec9639f None admin] PATH_INFO: `/v3/projects/1feabb3def254167851693a5df14463f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:37.304033 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f9cae-8457-4656-8534-d62baec9639f None admin] RBAC: Authorizing `identity:get_project(project_id=1feabb3def254167851693a5df14463f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:37.305466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f9cae-8457-4656-8534-d62baec9639f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:37.307166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 544/1096] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:10:37 2022] GET /identity/v3/projects/1feabb3def254167851693a5df14463f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:37.313055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9cae-8457-4656-8534-d62baec9639f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:37.335903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca31ff-2886-4fdc-9205-9b3a3cc1868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:37.336506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca31ff-2886-4fdc-9205-9b3a3cc1868e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:37.336788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca31ff-2886-4fdc-9205-9b3a3cc1868e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:37.337065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca31ff-2886-4fdc-9205-9b3a3cc1868e None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:37.337700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca31ff-2886-4fdc-9205-9b3a3cc1868e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:37.338004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca31ff-2886-4fdc-9205-9b3a3cc1868e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:37.339943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca31ff-2886-4fdc-9205-9b3a3cc1868e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:37.346665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:37.352062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 553/1097] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:37.357830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca31ff-2886-4fdc-9205-9b3a3cc1868e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:37.416479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9cae-8457-4656-8534-d62baec9639f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:37.445362 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:37.449056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194ff7e-97e2-4b61-9257-90d40f0ad929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:37.449684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194ff7e-97e2-4b61-9257-90d40f0ad929 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:37.449969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194ff7e-97e2-4b61-9257-90d40f0ad929 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:37.450279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194ff7e-97e2-4b61-9257-90d40f0ad929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:37.451059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194ff7e-97e2-4b61-9257-90d40f0ad929 None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=1feabb3def254167851693a5df14463f, user.id=e02c46895492497abfdf3025f101715d) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:37.451376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194ff7e-97e2-4b61-9257-90d40f0ad929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:37.452798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194ff7e-97e2-4b61-9257-90d40f0ad929 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:37.455033 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca31ff-2886-4fdc-9205-9b3a3cc1868e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:37.458445 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 545/1098] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:37 2022] GET /identity/v3/role_assignments?user.id=e02c46895492497abfdf3025f101715d&scope.project.id=1feabb3def254167851693a5df14463f&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:10:37.490826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eb60c-8b5f-4d35-a20c-abc3ec49ac9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:37.491478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eb60c-8b5f-4d35-a20c-abc3ec49ac9a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:37.491756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eb60c-8b5f-4d35-a20c-abc3ec49ac9a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:37.492025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eb60c-8b5f-4d35-a20c-abc3ec49ac9a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:37.499900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eb60c-8b5f-4d35-a20c-abc3ec49ac9a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:37.501375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eb60c-8b5f-4d35-a20c-abc3ec49ac9a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-ff1eb60c-8b5f-4d35-a20c-abc3ec49ac9a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:10:37.515541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:37.516738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:37.517696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:37.517696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:37.517696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:10:37.517696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:10:37.517696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:10:37.517696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:10:37.517696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:10:37.517696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:10:37.517696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 15:10:37.517696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:37.517696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 554/1099] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Aug 19 15:10:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:10:37.522895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194ff7e-97e2-4b61-9257-90d40f0ad929 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:37.629731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:37.633281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194ff7e-97e2-4b61-9257-90d40f0ad929 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:37.670155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aab291-7976-424b-91de-fa1a5b2b2c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:37.670757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aab291-7976-424b-91de-fa1a5b2b2c9a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:37.671034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aab291-7976-424b-91de-fa1a5b2b2c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:37.671303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aab291-7976-424b-91de-fa1a5b2b2c9a None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:37.672026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aab291-7976-424b-91de-fa1a5b2b2c9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:37.672333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aab291-7976-424b-91de-fa1a5b2b2c9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:37.673768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aab291-7976-424b-91de-fa1a5b2b2c9a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:37.691235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 546/1100] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Aug 19 15:10:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:37.697208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eb60c-8b5f-4d35-a20c-abc3ec49ac9a None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:37.795510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eb60c-8b5f-4d35-a20c-abc3ec49ac9a None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:37.828643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e9358-c7f6-460d-9b18-9787412a3511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:37.829245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e9358-c7f6-460d-9b18-9787412a3511 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:37.829520 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e9358-c7f6-460d-9b18-9787412a3511 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:37.829786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e9358-c7f6-460d-9b18-9787412a3511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:37.850250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:37.895141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e9358-c7f6-460d-9b18-9787412a3511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:37.896584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e9358-c7f6-460d-9b18-9787412a3511 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:37.990724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 555/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:10:37.996890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aab291-7976-424b-91de-fa1a5b2b2c9a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:38.091295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aab291-7976-424b-91de-fa1a5b2b2c9a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:38.124875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77b22a-13bc-44ec-a620-391c35ee437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:38.125490 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77b22a-13bc-44ec-a620-391c35ee437d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:38.125765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77b22a-13bc-44ec-a620-391c35ee437d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:38.126049 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77b22a-13bc-44ec-a620-391c35ee437d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:38.141798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77b22a-13bc-44ec-a620-391c35ee437d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:38.143261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77b22a-13bc-44ec-a620-391c35ee437d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-9c77b22a-13bc-44ec-a620-391c35ee437d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:10:38.157390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:38.158439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:10:38.159304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:10:38.159304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:10:38.159304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:38.159304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 547/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:38.164312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e9358-c7f6-460d-9b18-9787412a3511 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:38.214660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:38.260923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e9358-c7f6-460d-9b18-9787412a3511 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:38.293302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480a869-9aca-4246-8439-87281ee3c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:38.293897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480a869-9aca-4246-8439-87281ee3c398 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:38.294202 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480a869-9aca-4246-8439-87281ee3c398 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:38.294471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480a869-9aca-4246-8439-87281ee3c398 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:38.295095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480a869-9aca-4246-8439-87281ee3c398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:38.295394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480a869-9aca-4246-8439-87281ee3c398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:38.296735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480a869-9aca-4246-8439-87281ee3c398 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:38.307349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 556/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:38.313715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77b22a-13bc-44ec-a620-391c35ee437d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:38.325926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:38.411271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77b22a-13bc-44ec-a620-391c35ee437d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:38.444260 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5992217-3147-4a04-bd70-971f3ae30efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:38.444885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992217-3147-4a04-bd70-971f3ae30efd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:38.445169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992217-3147-4a04-bd70-971f3ae30efd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:38.445447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992217-3147-4a04-bd70-971f3ae30efd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:38.452082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5992217-3147-4a04-bd70-971f3ae30efd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:38.453507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5992217-3147-4a04-bd70-971f3ae30efd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-f5992217-3147-4a04-bd70-971f3ae30efd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:10:38.464976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:38.465871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:38.467283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:10:38.467283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:10:38.467283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:10:38.467283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:10:38.467283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:10:38.467283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:10:38.467283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:10:38.467283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:10:38.467283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 548/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:10:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:38.471994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480a869-9aca-4246-8439-87281ee3c398 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:38.571824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480a869-9aca-4246-8439-87281ee3c398 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:38.584414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:38.607258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be105a0-d2b5-447f-999c-ecd1fd810690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:38.607861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be105a0-d2b5-447f-999c-ecd1fd810690 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:38.608141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be105a0-d2b5-447f-999c-ecd1fd810690 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:38.608414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be105a0-d2b5-447f-999c-ecd1fd810690 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:38.609103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be105a0-d2b5-447f-999c-ecd1fd810690 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:38.609405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be105a0-d2b5-447f-999c-ecd1fd810690 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:38.610870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be105a0-d2b5-447f-999c-ecd1fd810690 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:38.622459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 557/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:10:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:38.628439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5992217-3147-4a04-bd70-971f3ae30efd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:38.694810 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:38.726234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5992217-3147-4a04-bd70-971f3ae30efd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:38.758583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af18acc-3c0d-4d83-ad50-e230cdc58b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:38.759173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af18acc-3c0d-4d83-ad50-e230cdc58b1b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:38.759453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af18acc-3c0d-4d83-ad50-e230cdc58b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:38.759726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af18acc-3c0d-4d83-ad50-e230cdc58b1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:38.760452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af18acc-3c0d-4d83-ad50-e230cdc58b1b None admin] RBAC: Adding query filter params (role.id=ffe0dfc406a649efb1b01761d344839a, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=a86ca59cbf894c508b3439b08715da86) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:38.761263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af18acc-3c0d-4d83-ad50-e230cdc58b1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:38.762715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af18acc-3c0d-4d83-ad50-e230cdc58b1b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:38.768485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 549/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:38 2022] GET /identity/v3/role_assignments?user.id=a86ca59cbf894c508b3439b08715da86&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=ffe0dfc406a649efb1b01761d344839a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:39.374615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0af8a-52f9-444c-9a14-c74e7ed3a865 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:39.375132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0af8a-52f9-444c-9a14-c74e7ed3a865 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:39.375243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0af8a-52f9-444c-9a14-c74e7ed3a865 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:39.376502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 558/1107] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:39.381971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098a750-5004-49a7-a573-d2ad7d753867 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:39.382399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098a750-5004-49a7-a573-d2ad7d753867 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:39.382610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098a750-5004-49a7-a573-d2ad7d753867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:39.401035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9098a750-5004-49a7-a573-d2ad7d753867 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:39.402271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9098a750-5004-49a7-a573-d2ad7d753867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:39.469548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 550/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:39.736131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0af8a-52f9-444c-9a14-c74e7ed3a865 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:39.834245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0af8a-52f9-444c-9a14-c74e7ed3a865 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:39.867973 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcc552-4ce1-4c2a-b586-42ed0b1ad79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:39.868589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc552-4ce1-4c2a-b586-42ed0b1ad79b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:39.868869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc552-4ce1-4c2a-b586-42ed0b1ad79b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:39.869141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcc552-4ce1-4c2a-b586-42ed0b1ad79b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:39.870430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcc552-4ce1-4c2a-b586-42ed0b1ad79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:39.872171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcc552-4ce1-4c2a-b586-42ed0b1ad79b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:39.873862 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 559/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:39.879578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098a750-5004-49a7-a573-d2ad7d753867 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:39.939778 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:39.975893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098a750-5004-49a7-a573-d2ad7d753867 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:40.008639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f1adb-fbd8-468f-9dea-da564fe9de55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:40.009225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f1adb-fbd8-468f-9dea-da564fe9de55 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:40.009506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f1adb-fbd8-468f-9dea-da564fe9de55 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:40.009783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f1adb-fbd8-468f-9dea-da564fe9de55 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:40.010447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f1adb-fbd8-468f-9dea-da564fe9de55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:40.011894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382f1adb-fbd8-468f-9dea-da564fe9de55 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:40.032341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 551/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:10:39 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:10:41.957567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc734f74-70f9-468f-b8be-4e68af84cd13 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:41.958108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc734f74-70f9-468f-b8be-4e68af84cd13 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:41.958108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc734f74-70f9-468f-b8be-4e68af84cd13 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:41.959393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 560/1111] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:41.964993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011257-3c3a-4d9d-a7d2-549a7b1925c5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:41.965421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011257-3c3a-4d9d-a7d2-549a7b1925c5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:41.965545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a011257-3c3a-4d9d-a7d2-549a7b1925c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:41.983280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4a011257-3c3a-4d9d-a7d2-549a7b1925c5 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:41.984463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4a011257-3c3a-4d9d-a7d2-549a7b1925c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:42.048149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 552/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:42.312929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc734f74-70f9-468f-b8be-4e68af84cd13 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:42.354934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:42.412301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc734f74-70f9-468f-b8be-4e68af84cd13 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:42.445683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956e5be-3655-4fc9-abeb-0c4c48c60836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:42.446329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956e5be-3655-4fc9-abeb-0c4c48c60836 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:42.446612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956e5be-3655-4fc9-abeb-0c4c48c60836 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:42.446887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956e5be-3655-4fc9-abeb-0c4c48c60836 None admin] PATH_INFO: `/v3/roles/924c0aaeca9d4fa6924529f3f93a2f7e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:42.448298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956e5be-3655-4fc9-abeb-0c4c48c60836 None admin] RBAC: Authorizing `identity:get_role(role_id=924c0aaeca9d4fa6924529f3f93a2f7e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:42.449667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956e5be-3655-4fc9-abeb-0c4c48c60836 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:42.450991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 561/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:10:42 2022] GET /identity/v3/roles/924c0aaeca9d4fa6924529f3f93a2f7e => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:42.456658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a011257-3c3a-4d9d-a7d2-549a7b1925c5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:42.504302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:42.552070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a011257-3c3a-4d9d-a7d2-549a7b1925c5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:42.584869 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807e6ce-e7b5-4e6d-8523-14bcce02d1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:42.585423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807e6ce-e7b5-4e6d-8523-14bcce02d1cc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:42.585701 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807e6ce-e7b5-4e6d-8523-14bcce02d1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:42.585972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807e6ce-e7b5-4e6d-8523-14bcce02d1cc None admin] PATH_INFO: `/v3/users/cb2f1fbb144f47a9a6810261852ce7d8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:42.598454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807e6ce-e7b5-4e6d-8523-14bcce02d1cc None admin] RBAC: Authorizing `identity:get_user(user_id=cb2f1fbb144f47a9a6810261852ce7d8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:42.599880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807e6ce-e7b5-4e6d-8523-14bcce02d1cc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:42.601442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 553/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:10:42 2022] GET /identity/v3/users/cb2f1fbb144f47a9a6810261852ce7d8 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:42.607915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956e5be-3655-4fc9-abeb-0c4c48c60836 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:42.703397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956e5be-3655-4fc9-abeb-0c4c48c60836 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:42.711774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:42.739020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663e592-01f6-4725-8a15-2839aeae4399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:42.739621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663e592-01f6-4725-8a15-2839aeae4399 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:42.739903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663e592-01f6-4725-8a15-2839aeae4399 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:42.740178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663e592-01f6-4725-8a15-2839aeae4399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:42.804366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663e592-01f6-4725-8a15-2839aeae4399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:42.805802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663e592-01f6-4725-8a15-2839aeae4399 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:42.899516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 562/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:10:42.905769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807e6ce-e7b5-4e6d-8523-14bcce02d1cc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:43.001692 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807e6ce-e7b5-4e6d-8523-14bcce02d1cc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:43.010599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:43.035138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a917e7-074e-4370-b291-cdbefbea2a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:43.035764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a917e7-074e-4370-b291-cdbefbea2a8d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:43.036047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a917e7-074e-4370-b291-cdbefbea2a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:43.036321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a917e7-074e-4370-b291-cdbefbea2a8d None admin] PATH_INFO: `/v3/projects/1feabb3def254167851693a5df14463f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:43.037490 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a917e7-074e-4370-b291-cdbefbea2a8d None admin] RBAC: Authorizing `identity:get_project(project_id=1feabb3def254167851693a5df14463f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:43.038934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a917e7-074e-4370-b291-cdbefbea2a8d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:43.040531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 554/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:10:42 2022] GET /identity/v3/projects/1feabb3def254167851693a5df14463f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:43.047115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663e592-01f6-4725-8a15-2839aeae4399 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:43.056907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:43.143250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663e592-01f6-4725-8a15-2839aeae4399 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:43.177784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8490a-c84d-4e76-89f2-26960bf0a370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:43.178492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8490a-c84d-4e76-89f2-26960bf0a370 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:43.178779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8490a-c84d-4e76-89f2-26960bf0a370 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:43.179056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8490a-c84d-4e76-89f2-26960bf0a370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:43.179785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8490a-c84d-4e76-89f2-26960bf0a370 None admin] RBAC: Adding query filter params (role.id=924c0aaeca9d4fa6924529f3f93a2f7e, scope.project.id=1feabb3def254167851693a5df14463f, user.id=cb2f1fbb144f47a9a6810261852ce7d8) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:43.180095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8490a-c84d-4e76-89f2-26960bf0a370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:43.181511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8490a-c84d-4e76-89f2-26960bf0a370 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:43.187431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 563/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:43 2022] GET /identity/v3/role_assignments?user.id=cb2f1fbb144f47a9a6810261852ce7d8&scope.project.id=1feabb3def254167851693a5df14463f&role.id=924c0aaeca9d4fa6924529f3f93a2f7e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:45.035234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1c714-8b26-4a19-91a6-213a8c61bb8c None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:45.035746 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1c714-8b26-4a19-91a6-213a8c61bb8c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:45.035840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1c714-8b26-4a19-91a6-213a8c61bb8c None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:45.037158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 555/1118] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:45.042466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa99f5-c91e-4f16-a711-2f935481f34c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:45.043077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa99f5-c91e-4f16-a711-2f935481f34c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:45.043256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa99f5-c91e-4f16-a711-2f935481f34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:45.061679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0dfa99f5-c91e-4f16-a711-2f935481f34c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:45.062899 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0dfa99f5-c91e-4f16-a711-2f935481f34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:45.126706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 564/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:45.397779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1c714-8b26-4a19-91a6-213a8c61bb8c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:45.495563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1c714-8b26-4a19-91a6-213a8c61bb8c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:45.528265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ad17e-1184-48a4-8864-9372b0119470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:45.528878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad17e-1184-48a4-8864-9372b0119470 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:45.529153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad17e-1184-48a4-8864-9372b0119470 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:45.529423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad17e-1184-48a4-8864-9372b0119470 None admin] PATH_INFO: `/v3/roles/924c0aaeca9d4fa6924529f3f93a2f7e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:45.530824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ad17e-1184-48a4-8864-9372b0119470 None admin] RBAC: Authorizing `identity:get_role(role_id=924c0aaeca9d4fa6924529f3f93a2f7e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:45.532166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ad17e-1184-48a4-8864-9372b0119470 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:45.533452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 556/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:10:45 2022] GET /identity/v3/roles/924c0aaeca9d4fa6924529f3f93a2f7e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:45.539216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa99f5-c91e-4f16-a711-2f935481f34c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:45.541375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:45.635416 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa99f5-c91e-4f16-a711-2f935481f34c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:45.668612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea5e7-6f76-4edb-b5c2-bd275994810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:45.669174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea5e7-6f76-4edb-b5c2-bd275994810e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:45.669453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea5e7-6f76-4edb-b5c2-bd275994810e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:45.669726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea5e7-6f76-4edb-b5c2-bd275994810e None admin] PATH_INFO: `/v3/users/cb2f1fbb144f47a9a6810261852ce7d8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:45.670860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea5e7-6f76-4edb-b5c2-bd275994810e None admin] RBAC: Authorizing `identity:get_user(user_id=cb2f1fbb144f47a9a6810261852ce7d8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:45.672278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea5e7-6f76-4edb-b5c2-bd275994810e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:45.673829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 565/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:10:45 2022] GET /identity/v3/users/cb2f1fbb144f47a9a6810261852ce7d8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:45.679555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ad17e-1184-48a4-8864-9372b0119470 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:45.725130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:45.778934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ad17e-1184-48a4-8864-9372b0119470 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:45.811446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d8667-55c8-4b74-800f-b0625137cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:45.812063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8667-55c8-4b74-800f-b0625137cb7d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:45.812345 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8667-55c8-4b74-800f-b0625137cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:45.812621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d8667-55c8-4b74-800f-b0625137cb7d None admin] PATH_INFO: `/v3/projects/1feabb3def254167851693a5df14463f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:45.813719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8667-55c8-4b74-800f-b0625137cb7d None admin] RBAC: Authorizing `identity:get_project(project_id=1feabb3def254167851693a5df14463f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:45.815176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d8667-55c8-4b74-800f-b0625137cb7d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:45.816773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 557/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:10:45 2022] GET /identity/v3/projects/1feabb3def254167851693a5df14463f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:45.822701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea5e7-6f76-4edb-b5c2-bd275994810e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:45.896227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:45.927430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea5e7-6f76-4edb-b5c2-bd275994810e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:45.958611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955dec8-6e39-4765-ae24-702cdd9fd0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:45.959250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955dec8-6e39-4765-ae24-702cdd9fd0ac None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:45.959530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955dec8-6e39-4765-ae24-702cdd9fd0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:45.959803 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955dec8-6e39-4765-ae24-702cdd9fd0ac None admin] PATH_INFO: `/v3/projects/1feabb3def254167851693a5df14463f/users/cb2f1fbb144f47a9a6810261852ce7d8/roles/924c0aaeca9d4fa6924529f3f93a2f7e` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:45.961904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955dec8-6e39-4765-ae24-702cdd9fd0ac None admin] RBAC: Authorizing `identity:create_grant(project_id=1feabb3def254167851693a5df14463f, user_id=cb2f1fbb144f47a9a6810261852ce7d8, role_id=924c0aaeca9d4fa6924529f3f93a2f7e)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:45.963353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955dec8-6e39-4765-ae24-702cdd9fd0ac None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:45.975550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 566/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:10:45 2022] PUT /identity/v3/projects/1feabb3def254167851693a5df14463f/users/cb2f1fbb144f47a9a6810261852ce7d8/roles/924c0aaeca9d4fa6924529f3f93a2f7e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:10:47.828319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917f7b-47d6-408c-9500-2f5b9d583102 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:47.828863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917f7b-47d6-408c-9500-2f5b9d583102 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:47.828863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94917f7b-47d6-408c-9500-2f5b9d583102 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:47.830170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 558/1124] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:47.835197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fddf10-d2c7-4ecb-aad0-3d03db0276ba None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:47.835588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fddf10-d2c7-4ecb-aad0-3d03db0276ba None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:47.835753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fddf10-d2c7-4ecb-aad0-3d03db0276ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:47.853206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-80fddf10-d2c7-4ecb-aad0-3d03db0276ba None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:47.855214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-80fddf10-d2c7-4ecb-aad0-3d03db0276ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:47.918829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 567/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:48.184278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94917f7b-47d6-408c-9500-2f5b9d583102 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:48.282561 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94917f7b-47d6-408c-9500-2f5b9d583102 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:48.295477 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:48.315927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc0724-2f40-4e9e-b2b6-970ee325d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:48.316539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0724-2f40-4e9e-b2b6-970ee325d26e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:48.316817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0724-2f40-4e9e-b2b6-970ee325d26e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:48.317088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0724-2f40-4e9e-b2b6-970ee325d26e None admin] PATH_INFO: `/v3/roles/924c0aaeca9d4fa6924529f3f93a2f7e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:48.318492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc0724-2f40-4e9e-b2b6-970ee325d26e None admin] RBAC: Authorizing `identity:get_role(role_id=924c0aaeca9d4fa6924529f3f93a2f7e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:48.319842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc0724-2f40-4e9e-b2b6-970ee325d26e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:48.321121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 559/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:10:48 2022] GET /identity/v3/roles/924c0aaeca9d4fa6924529f3f93a2f7e => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:48.326882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fddf10-d2c7-4ecb-aad0-3d03db0276ba None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:48.384415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:48.425155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fddf10-d2c7-4ecb-aad0-3d03db0276ba None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:48.457483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7866-b320-4be3-89bd-c57110add08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:48.458067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7866-b320-4be3-89bd-c57110add08c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:48.458352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7866-b320-4be3-89bd-c57110add08c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:48.458644 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c7866-b320-4be3-89bd-c57110add08c None admin] PATH_INFO: `/v3/users/cb2f1fbb144f47a9a6810261852ce7d8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:48.459730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c7866-b320-4be3-89bd-c57110add08c None admin] RBAC: Authorizing `identity:get_user(user_id=cb2f1fbb144f47a9a6810261852ce7d8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:48.461151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c7866-b320-4be3-89bd-c57110add08c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:48.462735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 568/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:10:48 2022] GET /identity/v3/users/cb2f1fbb144f47a9a6810261852ce7d8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:48.468962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc0724-2f40-4e9e-b2b6-970ee325d26e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:48.564591 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc0724-2f40-4e9e-b2b6-970ee325d26e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:48.597193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d9df9-40b3-4e36-8e19-6b3297cc0b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:48.597782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d9df9-40b3-4e36-8e19-6b3297cc0b60 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:48.598085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d9df9-40b3-4e36-8e19-6b3297cc0b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:48.598367 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d9df9-40b3-4e36-8e19-6b3297cc0b60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:48.643737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:48.663086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d9df9-40b3-4e36-8e19-6b3297cc0b60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:48.664509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d9df9-40b3-4e36-8e19-6b3297cc0b60 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:48.759138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 560/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:10:48.765000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7866-b320-4be3-89bd-c57110add08c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:48.861998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c7866-b320-4be3-89bd-c57110add08c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:48.886783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:48.894617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae108ba2-b946-4be0-a8b7-58b46e14825e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:48.895234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae108ba2-b946-4be0-a8b7-58b46e14825e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:48.895517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae108ba2-b946-4be0-a8b7-58b46e14825e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:48.895793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae108ba2-b946-4be0-a8b7-58b46e14825e None admin] PATH_INFO: `/v3/projects/1feabb3def254167851693a5df14463f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:48.896892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae108ba2-b946-4be0-a8b7-58b46e14825e None admin] RBAC: Authorizing `identity:get_project(project_id=1feabb3def254167851693a5df14463f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:48.898355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae108ba2-b946-4be0-a8b7-58b46e14825e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:48.899963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 569/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:10:48 2022] GET /identity/v3/projects/1feabb3def254167851693a5df14463f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:48.906482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d9df9-40b3-4e36-8e19-6b3297cc0b60 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:48.984027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:49.003222 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d9df9-40b3-4e36-8e19-6b3297cc0b60 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:49.036425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a445cd6-3604-49fd-a7eb-1d79a92f4ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:49.036999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a445cd6-3604-49fd-a7eb-1d79a92f4ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:49.037283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a445cd6-3604-49fd-a7eb-1d79a92f4ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:49.037557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a445cd6-3604-49fd-a7eb-1d79a92f4ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:49.038302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a445cd6-3604-49fd-a7eb-1d79a92f4ea3 None admin] RBAC: Adding query filter params (role.id=924c0aaeca9d4fa6924529f3f93a2f7e, scope.project.id=1feabb3def254167851693a5df14463f, user.id=cb2f1fbb144f47a9a6810261852ce7d8) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:49.038614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a445cd6-3604-49fd-a7eb-1d79a92f4ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:49.040030 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a445cd6-3604-49fd-a7eb-1d79a92f4ea3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:49.046228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 561/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:48 2022] GET /identity/v3/role_assignments?user.id=cb2f1fbb144f47a9a6810261852ce7d8&scope.project.id=1feabb3def254167851693a5df14463f&role.id=924c0aaeca9d4fa6924529f3f93a2f7e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:50.928639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfe16e-b8ca-484d-b5d3-b5ad9771e616 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:50.929140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfe16e-b8ca-484d-b5d3-b5ad9771e616 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:50.929140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfe16e-b8ca-484d-b5d3-b5ad9771e616 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:50.930478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 570/1131] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:50.936185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124ef7f-8943-4160-b183-e8a68d61162b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:50.936594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124ef7f-8943-4160-b183-e8a68d61162b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:50.936728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124ef7f-8943-4160-b183-e8a68d61162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:50.954185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e124ef7f-8943-4160-b183-e8a68d61162b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:50.955355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e124ef7f-8943-4160-b183-e8a68d61162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:51.018874 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 562/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:51.280216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfe16e-b8ca-484d-b5d3-b5ad9771e616 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:51.378742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfe16e-b8ca-484d-b5d3-b5ad9771e616 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:51.411465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1de0e8-0d3e-4abd-8437-51a7aae2f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:51.412076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1de0e8-0d3e-4abd-8437-51a7aae2f34e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:51.412355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1de0e8-0d3e-4abd-8437-51a7aae2f34e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:51.412628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1de0e8-0d3e-4abd-8437-51a7aae2f34e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:51.413726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1de0e8-0d3e-4abd-8437-51a7aae2f34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:51.415171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1de0e8-0d3e-4abd-8437-51a7aae2f34e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:51.416687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 571/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:51.422713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124ef7f-8943-4160-b183-e8a68d61162b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:51.493480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:51.517977 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124ef7f-8943-4160-b183-e8a68d61162b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:51.550668 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80973529-b9cb-489c-b80e-f9c76482b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:51.551201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973529-b9cb-489c-b80e-f9c76482b045 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:51.551478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973529-b9cb-489c-b80e-f9c76482b045 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:51.551746 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973529-b9cb-489c-b80e-f9c76482b045 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:51.552390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80973529-b9cb-489c-b80e-f9c76482b045 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:51.553943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80973529-b9cb-489c-b80e-f9c76482b045 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:51.580056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 563/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:10:51 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:10:53.473452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234befa8-8871-48d0-9445-ee580f10dfa7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:53.474003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234befa8-8871-48d0-9445-ee580f10dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:53.474003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234befa8-8871-48d0-9445-ee580f10dfa7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:53.475466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 572/1135] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:53.481315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f234d0-0df9-4011-8767-7c865503e064 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:53.481753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f234d0-0df9-4011-8767-7c865503e064 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:53.481853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f234d0-0df9-4011-8767-7c865503e064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:53.499415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-45f234d0-0df9-4011-8767-7c865503e064 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:53.500593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-45f234d0-0df9-4011-8767-7c865503e064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:53.565176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 564/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:53.834551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234befa8-8871-48d0-9445-ee580f10dfa7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:53.896510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:53.933549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234befa8-8871-48d0-9445-ee580f10dfa7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:53.966394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c7c70-e8da-4687-a4ed-cae18cffca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:53.967005 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7c70-e8da-4687-a4ed-cae18cffca5f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:53.967288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7c70-e8da-4687-a4ed-cae18cffca5f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:53.967559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7c70-e8da-4687-a4ed-cae18cffca5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:53.968656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c7c70-e8da-4687-a4ed-cae18cffca5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:53.970094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c7c70-e8da-4687-a4ed-cae18cffca5f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:53.971634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 573/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:10:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:53.977314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f234d0-0df9-4011-8767-7c865503e064 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:54.030873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:54.079000 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f234d0-0df9-4011-8767-7c865503e064 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:54.111131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b258be8-91ab-4b37-9dbd-8e39cac34370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:54.111658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258be8-91ab-4b37-9dbd-8e39cac34370 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:54.111935 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258be8-91ab-4b37-9dbd-8e39cac34370 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:54.112207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258be8-91ab-4b37-9dbd-8e39cac34370 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:54.112843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b258be8-91ab-4b37-9dbd-8e39cac34370 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:54.114278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b258be8-91ab-4b37-9dbd-8e39cac34370 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:54.136106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 565/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:10:53 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:10:56.132999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75241724-aaad-4c97-9ee7-dd0d80e9b595 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:56.133552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75241724-aaad-4c97-9ee7-dd0d80e9b595 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:56.133552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75241724-aaad-4c97-9ee7-dd0d80e9b595 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:56.134933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 574/1139] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:56.140603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80501f-3197-409d-939b-e63e75e1cd5e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:56.140992 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80501f-3197-409d-939b-e63e75e1cd5e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:56.141149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80501f-3197-409d-939b-e63e75e1cd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:56.159320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1b80501f-3197-409d-939b-e63e75e1cd5e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:56.160493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1b80501f-3197-409d-939b-e63e75e1cd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:56.224518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 566/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:10:56.490873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75241724-aaad-4c97-9ee7-dd0d80e9b595 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:56.588147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75241724-aaad-4c97-9ee7-dd0d80e9b595 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:56.616606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:56.622286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f651705-3370-4a3f-a132-621155c79ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:56.622913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f651705-3370-4a3f-a132-621155c79ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:56.623195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f651705-3370-4a3f-a132-621155c79ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:56.623471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f651705-3370-4a3f-a132-621155c79ba7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:56.633377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f651705-3370-4a3f-a132-621155c79ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-5f651705-3370-4a3f-a132-621155c79ba7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:56.638071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:56.639203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:56.640436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 575/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:56.645190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80501f-3197-409d-939b-e63e75e1cd5e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:56.686799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:56.741728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80501f-3197-409d-939b-e63e75e1cd5e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:56.774184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dbb51-ed22-4d9f-b0de-cfaa0ea95407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:56.774772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dbb51-ed22-4d9f-b0de-cfaa0ea95407 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:56.775077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dbb51-ed22-4d9f-b0de-cfaa0ea95407 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:56.775327 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dbb51-ed22-4d9f-b0de-cfaa0ea95407 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:56.776025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dbb51-ed22-4d9f-b0de-cfaa0ea95407 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:56.776828 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dbb51-ed22-4d9f-b0de-cfaa0ea95407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:56.778202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dbb51-ed22-4d9f-b0de-cfaa0ea95407 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:56.785809 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 567/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:56.791867 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f651705-3370-4a3f-a132-621155c79ba7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:56.888773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f651705-3370-4a3f-a132-621155c79ba7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:56.921159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5867dd-fc7d-45f8-aa3c-75bd3419649b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:56.921766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5867dd-fc7d-45f8-aa3c-75bd3419649b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:56.922126 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5867dd-fc7d-45f8-aa3c-75bd3419649b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:56.922477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5867dd-fc7d-45f8-aa3c-75bd3419649b None admin] PATH_INFO: `/v3/users/7af0cba2efd94033ae4aad018412e295` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:56.934775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5867dd-fc7d-45f8-aa3c-75bd3419649b None admin] RBAC: Authorizing `identity:get_user(user_id=7af0cba2efd94033ae4aad018412e295)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:56.936209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5867dd-fc7d-45f8-aa3c-75bd3419649b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:56.937766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 576/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:10:56 2022] GET /identity/v3/users/7af0cba2efd94033ae4aad018412e295 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:56.943697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dbb51-ed22-4d9f-b0de-cfaa0ea95407 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:57.040854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dbb51-ed22-4d9f-b0de-cfaa0ea95407 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:57.043146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:57.073748 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397557d-2e7c-4f4e-a226-489e5d859b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:57.074361 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397557d-2e7c-4f4e-a226-489e5d859b31 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:57.074640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397557d-2e7c-4f4e-a226-489e5d859b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:57.074911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397557d-2e7c-4f4e-a226-489e5d859b31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:57.138709 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397557d-2e7c-4f4e-a226-489e5d859b31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:57.140124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397557d-2e7c-4f4e-a226-489e5d859b31 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:57.232791 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 568/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:10:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:10:57.239547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5867dd-fc7d-45f8-aa3c-75bd3419649b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:57.288630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:57.337070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5867dd-fc7d-45f8-aa3c-75bd3419649b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:57.370148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3650bf-5ece-44a7-8c62-6c25f5ada62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:57.370762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3650bf-5ece-44a7-8c62-6c25f5ada62f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:57.371067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3650bf-5ece-44a7-8c62-6c25f5ada62f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:57.371337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3650bf-5ece-44a7-8c62-6c25f5ada62f None admin] PATH_INFO: `/v3/projects/96c349bac78347eb89254969607c89ca` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:57.372436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3650bf-5ece-44a7-8c62-6c25f5ada62f None admin] RBAC: Authorizing `identity:get_project(project_id=96c349bac78347eb89254969607c89ca)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:57.373848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3650bf-5ece-44a7-8c62-6c25f5ada62f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:57.375479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 577/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:10:57 2022] GET /identity/v3/projects/96c349bac78347eb89254969607c89ca => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:57.381571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397557d-2e7c-4f4e-a226-489e5d859b31 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:57.384641 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:57.480258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397557d-2e7c-4f4e-a226-489e5d859b31 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:57.512328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423cd78-528e-4b9d-b0b7-6d2224f53853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:57.512913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423cd78-528e-4b9d-b0b7-6d2224f53853 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:57.513187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423cd78-528e-4b9d-b0b7-6d2224f53853 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:57.513452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423cd78-528e-4b9d-b0b7-6d2224f53853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:57.514189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423cd78-528e-4b9d-b0b7-6d2224f53853 None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=96c349bac78347eb89254969607c89ca, user.id=7af0cba2efd94033ae4aad018412e295) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:10:57.514493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423cd78-528e-4b9d-b0b7-6d2224f53853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:10:57.515970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423cd78-528e-4b9d-b0b7-6d2224f53853 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:10:57.521412 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 569/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:10:57 2022] GET /identity/v3/role_assignments?user.id=7af0cba2efd94033ae4aad018412e295&scope.project.id=96c349bac78347eb89254969607c89ca&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:10:59.367497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dbe3c-6889-468d-961b-9c038dfd60a6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:59.368052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dbe3c-6889-468d-961b-9c038dfd60a6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:59.368052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dbe3c-6889-468d-961b-9c038dfd60a6 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:59.369362 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 578/1147] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:10:59.374631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc3ef-b459-4533-a988-384059daee35 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:59.375030 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc3ef-b459-4533-a988-384059daee35 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:59.375169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11fc3ef-b459-4533-a988-384059daee35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:59.392458 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c11fc3ef-b459-4533-a988-384059daee35 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:10:59.393622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c11fc3ef-b459-4533-a988-384059daee35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:10:59.452414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:59.458251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 570/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:10:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:10:59.724263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dbe3c-6889-468d-961b-9c038dfd60a6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:59.820763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dbe3c-6889-468d-961b-9c038dfd60a6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:10:59.839155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:10:59.856435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320991d-7296-4a38-bf0a-2a1ad914b484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:10:59.857048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320991d-7296-4a38-bf0a-2a1ad914b484 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:10:59.857325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320991d-7296-4a38-bf0a-2a1ad914b484 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:10:59.857594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320991d-7296-4a38-bf0a-2a1ad914b484 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:10:59.867133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320991d-7296-4a38-bf0a-2a1ad914b484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-2320991d-7296-4a38-bf0a-2a1ad914b484 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:10:59.871790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:10:59.872859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:10:59.874168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 579/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:10:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:10:59.878895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fc3ef-b459-4533-a988-384059daee35 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:10:59.974451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11fc3ef-b459-4533-a988-384059daee35 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:00.006174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c9723-7f1c-4818-8514-607a8a8173f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:00.006761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c9723-7f1c-4818-8514-607a8a8173f9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:00.007035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c9723-7f1c-4818-8514-607a8a8173f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:00.007302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c9723-7f1c-4818-8514-607a8a8173f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:00.007950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c9723-7f1c-4818-8514-607a8a8173f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:11:00.008248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c9723-7f1c-4818-8514-607a8a8173f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:00.009592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c9723-7f1c-4818-8514-607a8a8173f9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:00.017695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 571/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:10:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:11:00.023371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320991d-7296-4a38-bf0a-2a1ad914b484 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:00.120169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320991d-7296-4a38-bf0a-2a1ad914b484 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:00.153301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72328a4c-4c1a-47f3-9131-467eb2a0d286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:00.153917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72328a4c-4c1a-47f3-9131-467eb2a0d286 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:00.154234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72328a4c-4c1a-47f3-9131-467eb2a0d286 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:00.154512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72328a4c-4c1a-47f3-9131-467eb2a0d286 None admin] PATH_INFO: `/v3/users/7af0cba2efd94033ae4aad018412e295` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:00.155626 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72328a4c-4c1a-47f3-9131-467eb2a0d286 None admin] RBAC: Authorizing `identity:get_user(user_id=7af0cba2efd94033ae4aad018412e295)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:00.157052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72328a4c-4c1a-47f3-9131-467eb2a0d286 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:00.158645 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 580/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:11:00 2022] GET /identity/v3/users/7af0cba2efd94033ae4aad018412e295 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:00.164246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c9723-7f1c-4818-8514-607a8a8173f9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:00.222762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:00.262778 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c9723-7f1c-4818-8514-607a8a8173f9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:00.294553 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174aa3fa-9b2e-4089-8707-5d9b2582a56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:00.295163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aa3fa-9b2e-4089-8707-5d9b2582a56f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:00.295440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aa3fa-9b2e-4089-8707-5d9b2582a56f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:00.295708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174aa3fa-9b2e-4089-8707-5d9b2582a56f None admin] PATH_INFO: `/v3/projects/96c349bac78347eb89254969607c89ca` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:00.296802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aa3fa-9b2e-4089-8707-5d9b2582a56f None admin] RBAC: Authorizing `identity:get_project(project_id=96c349bac78347eb89254969607c89ca)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:00.298240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174aa3fa-9b2e-4089-8707-5d9b2582a56f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:00.299813 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 572/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:11:00 2022] GET /identity/v3/projects/96c349bac78347eb89254969607c89ca => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:00.305486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72328a4c-4c1a-47f3-9131-467eb2a0d286 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:00.351268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:00.403851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72328a4c-4c1a-47f3-9131-467eb2a0d286 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:00.435180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905229a-2b01-43cf-a868-613995c44137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:00.435820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905229a-2b01-43cf-a868-613995c44137 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:00.436100 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905229a-2b01-43cf-a868-613995c44137 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:00.436373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905229a-2b01-43cf-a868-613995c44137 None admin] PATH_INFO: `/v3/projects/96c349bac78347eb89254969607c89ca/users/7af0cba2efd94033ae4aad018412e295/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:00.438261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905229a-2b01-43cf-a868-613995c44137 None admin] RBAC: Authorizing `identity:create_grant(project_id=96c349bac78347eb89254969607c89ca, user_id=7af0cba2efd94033ae4aad018412e295, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:00.439673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905229a-2b01-43cf-a868-613995c44137 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:00.452953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 581/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:11:00 2022] PUT /identity/v3/projects/96c349bac78347eb89254969607c89ca/users/7af0cba2efd94033ae4aad018412e295/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:11:02.288780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aba528-f553-4077-bb70-b84ee6bdee3a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:02.289327 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aba528-f553-4077-bb70-b84ee6bdee3a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:02.289327 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aba528-f553-4077-bb70-b84ee6bdee3a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:02.290816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 573/1154] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:11:02.296437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23cc28-b334-4511-9a59-973444af4fd4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:02.296815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23cc28-b334-4511-9a59-973444af4fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:02.296986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23cc28-b334-4511-9a59-973444af4fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:02.314490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5d23cc28-b334-4511-9a59-973444af4fd4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:11:02.315661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5d23cc28-b334-4511-9a59-973444af4fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:11:02.378940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 582/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:11:02.644655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aba528-f553-4077-bb70-b84ee6bdee3a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:02.742605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aba528-f553-4077-bb70-b84ee6bdee3a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:02.768246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:02.776048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c088c-bf37-44cd-a3e1-9a718131ce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:02.776666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c088c-bf37-44cd-a3e1-9a718131ce92 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:02.776947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c088c-bf37-44cd-a3e1-9a718131ce92 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:02.777785 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c088c-bf37-44cd-a3e1-9a718131ce92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:02.787639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c088c-bf37-44cd-a3e1-9a718131ce92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d48c088c-bf37-44cd-a3e1-9a718131ce92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:11:02.792282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:11:02.794107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:11:02.795072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 574/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:11:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:11:02.799921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23cc28-b334-4511-9a59-973444af4fd4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:02.832759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:02.894367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23cc28-b334-4511-9a59-973444af4fd4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:02.926886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4de21-f238-4f1d-ae85-9e13b913ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:02.927477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4de21-f238-4f1d-ae85-9e13b913ba29 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:02.927753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4de21-f238-4f1d-ae85-9e13b913ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:02.928021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4de21-f238-4f1d-ae85-9e13b913ba29 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:02.928672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4de21-f238-4f1d-ae85-9e13b913ba29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:11:02.928975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4de21-f238-4f1d-ae85-9e13b913ba29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:02.930353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4de21-f238-4f1d-ae85-9e13b913ba29 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:02.938565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 583/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:11:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:02.944195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c088c-bf37-44cd-a3e1-9a718131ce92 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:03.040213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c088c-bf37-44cd-a3e1-9a718131ce92 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:03.072546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5d8a1-6ecb-496d-bb2f-1938a923cf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:03.073154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d8a1-6ecb-496d-bb2f-1938a923cf2d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:03.073432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d8a1-6ecb-496d-bb2f-1938a923cf2d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:03.073705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d8a1-6ecb-496d-bb2f-1938a923cf2d None admin] PATH_INFO: `/v3/users/7af0cba2efd94033ae4aad018412e295` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:03.074859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5d8a1-6ecb-496d-bb2f-1938a923cf2d None admin] RBAC: Authorizing `identity:get_user(user_id=7af0cba2efd94033ae4aad018412e295)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:03.076296 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5d8a1-6ecb-496d-bb2f-1938a923cf2d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:03.077804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 575/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:11:02 2022] GET /identity/v3/users/7af0cba2efd94033ae4aad018412e295 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:03.083767 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4de21-f238-4f1d-ae85-9e13b913ba29 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:03.176558 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:03.180718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4de21-f238-4f1d-ae85-9e13b913ba29 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:03.212292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbfc96-5066-4efc-b8d0-7b4aba9ca697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:03.212879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbfc96-5066-4efc-b8d0-7b4aba9ca697 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:03.213158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbfc96-5066-4efc-b8d0-7b4aba9ca697 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:03.213430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbfc96-5066-4efc-b8d0-7b4aba9ca697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:03.279076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbfc96-5066-4efc-b8d0-7b4aba9ca697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:03.280511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbfc96-5066-4efc-b8d0-7b4aba9ca697 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:03.370379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:03.375128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 584/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:11:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:11:03.380829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5d8a1-6ecb-496d-bb2f-1938a923cf2d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:03.435962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:03.477390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5d8a1-6ecb-496d-bb2f-1938a923cf2d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:03.510068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7155f3-442a-48a8-85c7-33ab8b63d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:03.510679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7155f3-442a-48a8-85c7-33ab8b63d671 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:03.510959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7155f3-442a-48a8-85c7-33ab8b63d671 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:03.511233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7155f3-442a-48a8-85c7-33ab8b63d671 None admin] PATH_INFO: `/v3/projects/96c349bac78347eb89254969607c89ca` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:03.512346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7155f3-442a-48a8-85c7-33ab8b63d671 None admin] RBAC: Authorizing `identity:get_project(project_id=96c349bac78347eb89254969607c89ca)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:03.513756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7155f3-442a-48a8-85c7-33ab8b63d671 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:03.515364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 576/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:11:03 2022] GET /identity/v3/projects/96c349bac78347eb89254969607c89ca => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:03.521232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbfc96-5066-4efc-b8d0-7b4aba9ca697 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:03.616567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbfc96-5066-4efc-b8d0-7b4aba9ca697 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:03.649422 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3311cf0-a66b-499d-a872-0f5a74bb7e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:03.649959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311cf0-a66b-499d-a872-0f5a74bb7e99 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:03.650268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311cf0-a66b-499d-a872-0f5a74bb7e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:03.650544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3311cf0-a66b-499d-a872-0f5a74bb7e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:03.651263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3311cf0-a66b-499d-a872-0f5a74bb7e99 None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=96c349bac78347eb89254969607c89ca, user.id=7af0cba2efd94033ae4aad018412e295) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:11:03.651574 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3311cf0-a66b-499d-a872-0f5a74bb7e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:03.652988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3311cf0-a66b-499d-a872-0f5a74bb7e99 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:03.658554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 585/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:11:03 2022] GET /identity/v3/role_assignments?user.id=7af0cba2efd94033ae4aad018412e295&scope.project.id=96c349bac78347eb89254969607c89ca&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:05.554055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ce505-2db0-4d49-8904-3605935d427f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:05.554055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ce505-2db0-4d49-8904-3605935d427f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:05.554491 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ce505-2db0-4d49-8904-3605935d427f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:05.555421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 577/1162] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:11:05.560697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd64ae5-8227-42e5-bc88-d66f5d6deaaf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:05.561097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd64ae5-8227-42e5-bc88-d66f5d6deaaf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:05.561253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd64ae5-8227-42e5-bc88-d66f5d6deaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:05.578691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ebd64ae5-8227-42e5-bc88-d66f5d6deaaf None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:11:05.579887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ebd64ae5-8227-42e5-bc88-d66f5d6deaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:11:05.634564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:05.645430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 586/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:11:05.910905 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ce505-2db0-4d49-8904-3605935d427f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:06.008517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ce505-2db0-4d49-8904-3605935d427f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:06.032812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:06.043719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84eca-9cb0-47a6-8b4e-d6e2f7b9795c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:06.044309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84eca-9cb0-47a6-8b4e-d6e2f7b9795c None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:06.044585 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84eca-9cb0-47a6-8b4e-d6e2f7b9795c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:06.044854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84eca-9cb0-47a6-8b4e-d6e2f7b9795c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:06.108962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc84eca-9cb0-47a6-8b4e-d6e2f7b9795c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:06.110415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc84eca-9cb0-47a6-8b4e-d6e2f7b9795c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:06.202050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 578/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:11:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:11:06.207906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd64ae5-8227-42e5-bc88-d66f5d6deaaf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:06.301482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd64ae5-8227-42e5-bc88-d66f5d6deaaf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:06.334420 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f8865-c8bd-4cf8-8069-cf7dd50e2677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:06.335033 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f8865-c8bd-4cf8-8069-cf7dd50e2677 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:06.335312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f8865-c8bd-4cf8-8069-cf7dd50e2677 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:06.335582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f8865-c8bd-4cf8-8069-cf7dd50e2677 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:06.342530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f8865-c8bd-4cf8-8069-cf7dd50e2677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:06.343951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f8865-c8bd-4cf8-8069-cf7dd50e2677 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-521f8865-c8bd-4cf8-8069-cf7dd50e2677 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:11:06.355052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:11:06.356806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:11:06.357861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 587/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 19 15:11:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:11:06.362548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84eca-9cb0-47a6-8b4e-d6e2f7b9795c None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:06.385859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:06.458442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84eca-9cb0-47a6-8b4e-d6e2f7b9795c None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:06.491237 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26843624-af04-4a8c-ba60-1e8045346792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:06.491828 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26843624-af04-4a8c-ba60-1e8045346792 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:06.492109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26843624-af04-4a8c-ba60-1e8045346792 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:06.492380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26843624-af04-4a8c-ba60-1e8045346792 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:06.493012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26843624-af04-4a8c-ba60-1e8045346792 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:11:06.493318 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26843624-af04-4a8c-ba60-1e8045346792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:06.494687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26843624-af04-4a8c-ba60-1e8045346792 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:06.501536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 579/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Aug 19 15:11:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:08.360502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9218aa-6ed2-44a2-b6d6-5d235dbd5646 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:08.361028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9218aa-6ed2-44a2-b6d6-5d235dbd5646 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:08.361028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9218aa-6ed2-44a2-b6d6-5d235dbd5646 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:08.362395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 588/1167] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:11:08.367526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789340b7-06f9-42a6-acb4-d9b1d11dac0f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:08.367940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789340b7-06f9-42a6-acb4-d9b1d11dac0f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:08.368084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789340b7-06f9-42a6-acb4-d9b1d11dac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:08.385605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-789340b7-06f9-42a6-acb4-d9b1d11dac0f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:11:08.386822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-789340b7-06f9-42a6-acb4-d9b1d11dac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:11:08.450751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 580/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:11:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:11:08.719932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9218aa-6ed2-44a2-b6d6-5d235dbd5646 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:08.772202 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:08.817941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9218aa-6ed2-44a2-b6d6-5d235dbd5646 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:08.851592 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ec8fe-27e2-4bc4-9c57-ec82fb6c83ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:08.852182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec8fe-27e2-4bc4-9c57-ec82fb6c83ee None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:08.852460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec8fe-27e2-4bc4-9c57-ec82fb6c83ee None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:08.852730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ec8fe-27e2-4bc4-9c57-ec82fb6c83ee None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:08.853380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ec8fe-27e2-4bc4-9c57-ec82fb6c83ee None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:08.855048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ec8fe-27e2-4bc4-9c57-ec82fb6c83ee None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:08.869863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 589/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Fri Aug 19 15:11:08 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:11:10.756242 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449424c-42e6-4b01-9f49-cff17cc9db1d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:10.756773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449424c-42e6-4b01-9f49-cff17cc9db1d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:10.756773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449424c-42e6-4b01-9f49-cff17cc9db1d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:10.758135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 581/1170] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:11:10.763262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b9294-2dca-4920-b5d7-01c348fcc645 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:10.763679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b9294-2dca-4920-b5d7-01c348fcc645 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:10.763823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b9294-2dca-4920-b5d7-01c348fcc645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:10.781818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-832b9294-2dca-4920-b5d7-01c348fcc645 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:11:10.783043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-832b9294-2dca-4920-b5d7-01c348fcc645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:11:10.846361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 590/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:11:11.110508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449424c-42e6-4b01-9f49-cff17cc9db1d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:11.129366 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:11.208159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449424c-42e6-4b01-9f49-cff17cc9db1d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:11.240230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b264943-300e-46dc-843c-4185667fb8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:11.240836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b264943-300e-46dc-843c-4185667fb8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:11.241118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b264943-300e-46dc-843c-4185667fb8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:11.241386 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b264943-300e-46dc-843c-4185667fb8e1 None admin] PATH_INFO: `/v3/domains/daefee9de99f4d0487c5654f5e921f0c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:11.251774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b264943-300e-46dc-843c-4185667fb8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=daefee9de99f4d0487c5654f5e921f0c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:11.253187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b264943-300e-46dc-843c-4185667fb8e1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:11.254758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 582/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Aug 19 15:11:11 2022] GET /identity/v3/domains/daefee9de99f4d0487c5654f5e921f0c => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:11.260583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b9294-2dca-4920-b5d7-01c348fcc645 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:11.301892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:11.356525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b9294-2dca-4920-b5d7-01c348fcc645 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:11.388050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb36194-19c8-40b6-b2e0-87793355bc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:11.388584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb36194-19c8-40b6-b2e0-87793355bc08 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:11.388861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb36194-19c8-40b6-b2e0-87793355bc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:11.389127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb36194-19c8-40b6-b2e0-87793355bc08 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:11.389760 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb36194-19c8-40b6-b2e0-87793355bc08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:11.391203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb36194-19c8-40b6-b2e0-87793355bc08 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:11.416490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 591/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:11:11 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:11:13.301510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52d87-2c68-494f-8a2b-1da125e97aa0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:13.302099 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52d87-2c68-494f-8a2b-1da125e97aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:13.302099 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52d87-2c68-494f-8a2b-1da125e97aa0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:13.303390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 583/1174] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:11:13.309086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e992b-a4f7-4eec-b5aa-5fa59d0bc60e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:13.309487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e992b-a4f7-4eec-b5aa-5fa59d0bc60e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:13.309642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e992b-a4f7-4eec-b5aa-5fa59d0bc60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:13.327283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ca7e992b-a4f7-4eec-b5aa-5fa59d0bc60e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:11:13.328473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ca7e992b-a4f7-4eec-b5aa-5fa59d0bc60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:11:13.392440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 592/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:11:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:11:13.662751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52d87-2c68-494f-8a2b-1da125e97aa0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:13.738642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:13.760361 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52d87-2c68-494f-8a2b-1da125e97aa0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:13.792544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68766045-917c-41c5-b2ef-5067eee6a83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:13.793146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68766045-917c-41c5-b2ef-5067eee6a83d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:13.793421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68766045-917c-41c5-b2ef-5067eee6a83d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:13.793686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68766045-917c-41c5-b2ef-5067eee6a83d None admin] PATH_INFO: `/v3/domains/daefee9de99f4d0487c5654f5e921f0c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:13.794802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68766045-917c-41c5-b2ef-5067eee6a83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=daefee9de99f4d0487c5654f5e921f0c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:13.796207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68766045-917c-41c5-b2ef-5067eee6a83d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:13.797715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 584/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Aug 19 15:11:13 2022] GET /identity/v3/domains/daefee9de99f4d0487c5654f5e921f0c => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:13.803552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e992b-a4f7-4eec-b5aa-5fa59d0bc60e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:13.828216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:13.901163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e992b-a4f7-4eec-b5aa-5fa59d0bc60e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:13.934297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bfc2c-27d5-4d80-99c5-d363c2428ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:13.934896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bfc2c-27d5-4d80-99c5-d363c2428ab4 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:13.935178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bfc2c-27d5-4d80-99c5-d363c2428ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:13.935453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bfc2c-27d5-4d80-99c5-d363c2428ab4 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:13.936090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bfc2c-27d5-4d80-99c5-d363c2428ab4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:13.937514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bfc2c-27d5-4d80-99c5-d363c2428ab4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:13.958196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 593/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:11:13 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:11:15.849447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de0057-22b2-44f2-8b69-452036dc85a4 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:15.849943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de0057-22b2-44f2-8b69-452036dc85a4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:15.849943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de0057-22b2-44f2-8b69-452036dc85a4 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:15.851264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 585/1178] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:11:15.857300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60474535-aa63-48e0-86a8-db72487a2fcf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:15.857733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60474535-aa63-48e0-86a8-db72487a2fcf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:15.857826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60474535-aa63-48e0-86a8-db72487a2fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:15.875236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-60474535-aa63-48e0-86a8-db72487a2fcf None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:11:15.876399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-60474535-aa63-48e0-86a8-db72487a2fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:11:15.939800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 594/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:11:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:11:16.204089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de0057-22b2-44f2-8b69-452036dc85a4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:16.302359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de0057-22b2-44f2-8b69-452036dc85a4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:16.334846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e56dc-1b48-4f16-8f80-4c5a5153727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:16.335448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e56dc-1b48-4f16-8f80-4c5a5153727a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:16.335726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e56dc-1b48-4f16-8f80-4c5a5153727a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:16.335996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e56dc-1b48-4f16-8f80-4c5a5153727a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:16.345687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e56dc-1b48-4f16-8f80-4c5a5153727a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6d2e56dc-1b48-4f16-8f80-4c5a5153727a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:11:16.350325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:11:16.351405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:11:16.352404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 586/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:11:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:11:16.357907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60474535-aa63-48e0-86a8-db72487a2fcf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:16.369150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:16.453985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60474535-aa63-48e0-86a8-db72487a2fcf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:16.487456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d71be-8be8-4070-bab0-eebb4ac2e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:16.487994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d71be-8be8-4070-bab0-eebb4ac2e391 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:16.488274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d71be-8be8-4070-bab0-eebb4ac2e391 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:16.488547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d71be-8be8-4070-bab0-eebb4ac2e391 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:16.489209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d71be-8be8-4070-bab0-eebb4ac2e391 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:11:16.489511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d71be-8be8-4070-bab0-eebb4ac2e391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:16.490893 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d71be-8be8-4070-bab0-eebb4ac2e391 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:16.499181 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 595/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:11:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:16.504947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e56dc-1b48-4f16-8f80-4c5a5153727a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:16.514158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:16.601698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e56dc-1b48-4f16-8f80-4c5a5153727a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:16.634479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73e43b-0b9b-458f-a78c-e3968cfbeea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:16.635094 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e43b-0b9b-458f-a78c-e3968cfbeea0 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:16.635374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e43b-0b9b-458f-a78c-e3968cfbeea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:16.635646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73e43b-0b9b-458f-a78c-e3968cfbeea0 None admin] PATH_INFO: `/v3/users/44afc3a8ac504002a8ef0f343c4f4895` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:16.648061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73e43b-0b9b-458f-a78c-e3968cfbeea0 None admin] RBAC: Authorizing `identity:get_user(user_id=44afc3a8ac504002a8ef0f343c4f4895)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:16.649497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73e43b-0b9b-458f-a78c-e3968cfbeea0 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:16.651098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 587/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:11:16 2022] GET /identity/v3/users/44afc3a8ac504002a8ef0f343c4f4895 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:16.657523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d71be-8be8-4070-bab0-eebb4ac2e391 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:16.724266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:16.753873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d71be-8be8-4070-bab0-eebb4ac2e391 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:16.786245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03363971-cb41-46b7-a61a-55afc7c81094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:16.786844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03363971-cb41-46b7-a61a-55afc7c81094 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:16.787127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03363971-cb41-46b7-a61a-55afc7c81094 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:16.787399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03363971-cb41-46b7-a61a-55afc7c81094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:16.851917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03363971-cb41-46b7-a61a-55afc7c81094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:16.853369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03363971-cb41-46b7-a61a-55afc7c81094 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:16.918833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:16.947384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 596/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:11:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:11:16.953750 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73e43b-0b9b-458f-a78c-e3968cfbeea0 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:17.013534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:17.049356 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73e43b-0b9b-458f-a78c-e3968cfbeea0 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:17.081603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc075107-ca16-4255-945d-584a9df88a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:17.082250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc075107-ca16-4255-945d-584a9df88a21 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:17.082526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc075107-ca16-4255-945d-584a9df88a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:17.082796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc075107-ca16-4255-945d-584a9df88a21 None admin] PATH_INFO: `/v3/projects/abc17831e25740a5a4b03826fd00a6e0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:17.083880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc075107-ca16-4255-945d-584a9df88a21 None admin] RBAC: Authorizing `identity:get_project(project_id=abc17831e25740a5a4b03826fd00a6e0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:17.085289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc075107-ca16-4255-945d-584a9df88a21 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:17.086913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 588/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:11:16 2022] GET /identity/v3/projects/abc17831e25740a5a4b03826fd00a6e0 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:17.093512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03363971-cb41-46b7-a61a-55afc7c81094 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:17.188070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03363971-cb41-46b7-a61a-55afc7c81094 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:17.221331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81199b5f-5e05-407a-9602-3ce6837605ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:17.221925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81199b5f-5e05-407a-9602-3ce6837605ef None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:17.222235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81199b5f-5e05-407a-9602-3ce6837605ef None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:17.222510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81199b5f-5e05-407a-9602-3ce6837605ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:17.223227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81199b5f-5e05-407a-9602-3ce6837605ef None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=abc17831e25740a5a4b03826fd00a6e0, user.id=44afc3a8ac504002a8ef0f343c4f4895) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:11:17.223534 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81199b5f-5e05-407a-9602-3ce6837605ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:17.224945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81199b5f-5e05-407a-9602-3ce6837605ef None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:17.230399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 597/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:11:17 2022] GET /identity/v3/role_assignments?user.id=44afc3a8ac504002a8ef0f343c4f4895&scope.project.id=abc17831e25740a5a4b03826fd00a6e0&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:19.096251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25fbf2-dc5a-410d-b06e-fb03ef9a70dc None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:19.096774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25fbf2-dc5a-410d-b06e-fb03ef9a70dc None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:19.096774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25fbf2-dc5a-410d-b06e-fb03ef9a70dc None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:19.098134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 589/1186] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:11:19.103128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931b66-1c54-481c-9714-e3f6ddb49abb None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:19.103782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931b66-1c54-481c-9714-e3f6ddb49abb None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:19.103935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9931b66-1c54-481c-9714-e3f6ddb49abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:19.121907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f9931b66-1c54-481c-9714-e3f6ddb49abb None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:11:19.123124 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f9931b66-1c54-481c-9714-e3f6ddb49abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:11:19.150784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:19.188475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 598/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:11:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:11:19.458017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25fbf2-dc5a-410d-b06e-fb03ef9a70dc None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:19.557368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25fbf2-dc5a-410d-b06e-fb03ef9a70dc None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:19.586003 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:19.591387 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12b943-a9ed-4887-9514-3660dea84f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:19.592006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b943-a9ed-4887-9514-3660dea84f62 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:19.592286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b943-a9ed-4887-9514-3660dea84f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:19.592556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b943-a9ed-4887-9514-3660dea84f62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:19.602316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12b943-a9ed-4887-9514-3660dea84f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ad12b943-a9ed-4887-9514-3660dea84f62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:11:19.607207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:11:19.608364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:11:19.609449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 590/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:11:19.614286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9931b66-1c54-481c-9714-e3f6ddb49abb None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:19.709647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9931b66-1c54-481c-9714-e3f6ddb49abb None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:19.742497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03605bd-f3ca-4cfe-818e-02e541970ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:19.743089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03605bd-f3ca-4cfe-818e-02e541970ffb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:19.743365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03605bd-f3ca-4cfe-818e-02e541970ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:19.743637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03605bd-f3ca-4cfe-818e-02e541970ffb None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:19.744294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03605bd-f3ca-4cfe-818e-02e541970ffb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:11:19.744595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03605bd-f3ca-4cfe-818e-02e541970ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:19.746506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03605bd-f3ca-4cfe-818e-02e541970ffb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:19.754240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 599/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:19.759947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12b943-a9ed-4887-9514-3660dea84f62 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:19.855994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12b943-a9ed-4887-9514-3660dea84f62 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:19.889333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a358be-bd35-48c3-8b96-ea7a45100168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:19.889936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a358be-bd35-48c3-8b96-ea7a45100168 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:19.890239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a358be-bd35-48c3-8b96-ea7a45100168 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:19.890509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a358be-bd35-48c3-8b96-ea7a45100168 None admin] PATH_INFO: `/v3/users/44afc3a8ac504002a8ef0f343c4f4895` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:19.891612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a358be-bd35-48c3-8b96-ea7a45100168 None admin] RBAC: Authorizing `identity:get_user(user_id=44afc3a8ac504002a8ef0f343c4f4895)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:19.893025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a358be-bd35-48c3-8b96-ea7a45100168 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:19.894595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 591/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:11:19 2022] GET /identity/v3/users/44afc3a8ac504002a8ef0f343c4f4895 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:19.900088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03605bd-f3ca-4cfe-818e-02e541970ffb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:19.928486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:19.997651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03605bd-f3ca-4cfe-818e-02e541970ffb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:20.029114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f037c3-fbac-4248-9719-cee613e57fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:20.029724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f037c3-fbac-4248-9719-cee613e57fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:20.030004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f037c3-fbac-4248-9719-cee613e57fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:20.030309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f037c3-fbac-4248-9719-cee613e57fe9 None admin] PATH_INFO: `/v3/projects/abc17831e25740a5a4b03826fd00a6e0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:20.031401 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f037c3-fbac-4248-9719-cee613e57fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=abc17831e25740a5a4b03826fd00a6e0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:20.032817 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f037c3-fbac-4248-9719-cee613e57fe9 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:20.034441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 600/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:11:19 2022] GET /identity/v3/projects/abc17831e25740a5a4b03826fd00a6e0 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:20.040335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a358be-bd35-48c3-8b96-ea7a45100168 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:20.096864 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:20.136324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a358be-bd35-48c3-8b96-ea7a45100168 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:20.168597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860d9c7-1109-48a5-ab80-c97e77e64c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:20.169230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860d9c7-1109-48a5-ab80-c97e77e64c5c None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:20.169508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860d9c7-1109-48a5-ab80-c97e77e64c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:20.169779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860d9c7-1109-48a5-ab80-c97e77e64c5c None admin] PATH_INFO: `/v3/projects/abc17831e25740a5a4b03826fd00a6e0/users/44afc3a8ac504002a8ef0f343c4f4895/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:20.171665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860d9c7-1109-48a5-ab80-c97e77e64c5c None admin] RBAC: Authorizing `identity:create_grant(project_id=abc17831e25740a5a4b03826fd00a6e0, user_id=44afc3a8ac504002a8ef0f343c4f4895, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:20.173071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860d9c7-1109-48a5-ab80-c97e77e64c5c None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:20.185560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 592/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:11:20 2022] PUT /identity/v3/projects/abc17831e25740a5a4b03826fd00a6e0/users/44afc3a8ac504002a8ef0f343c4f4895/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:11:22.040917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fba80-5fdf-4d9d-a584-8aef0d691ebf None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:22.041450 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fba80-5fdf-4d9d-a584-8aef0d691ebf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:22.041450 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fba80-5fdf-4d9d-a584-8aef0d691ebf None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:22.042829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 601/1193] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:11:22.047827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aeb73-7a4a-46b4-8665-674d6435ffc8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:22.048253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aeb73-7a4a-46b4-8665-674d6435ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:22.048378 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8aeb73-7a4a-46b4-8665-674d6435ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:22.066275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0e8aeb73-7a4a-46b4-8665-674d6435ffc8 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:11:22.067445 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0e8aeb73-7a4a-46b4-8665-674d6435ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:11:22.131013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 593/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:11:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:11:22.399925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fba80-5fdf-4d9d-a584-8aef0d691ebf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:22.491451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:22.499038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fba80-5fdf-4d9d-a584-8aef0d691ebf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:22.531365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4971dd-3a46-4f7b-aa60-12c89705369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:22.531984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4971dd-3a46-4f7b-aa60-12c89705369c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:22.532261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4971dd-3a46-4f7b-aa60-12c89705369c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:22.532529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4971dd-3a46-4f7b-aa60-12c89705369c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:22.542170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4971dd-3a46-4f7b-aa60-12c89705369c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4a4971dd-3a46-4f7b-aa60-12c89705369c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:11:22.547326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:11:22.548399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:11:22.549641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 602/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:11:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:11:22.554408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aeb73-7a4a-46b4-8665-674d6435ffc8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:22.601571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:22.652594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8aeb73-7a4a-46b4-8665-674d6435ffc8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:22.685091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229035b-c9a2-469b-a25d-89e7419a1323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:22.685679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229035b-c9a2-469b-a25d-89e7419a1323 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:22.685952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229035b-c9a2-469b-a25d-89e7419a1323 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:22.686284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229035b-c9a2-469b-a25d-89e7419a1323 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:22.686966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229035b-c9a2-469b-a25d-89e7419a1323 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:11:22.687291 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229035b-c9a2-469b-a25d-89e7419a1323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:22.688626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229035b-c9a2-469b-a25d-89e7419a1323 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:22.696306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 594/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:11:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:22.702053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4971dd-3a46-4f7b-aa60-12c89705369c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:22.798448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4971dd-3a46-4f7b-aa60-12c89705369c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:22.830206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2ac1-19c8-4b76-b07e-424a036c0363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:22.830816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2ac1-19c8-4b76-b07e-424a036c0363 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:22.831095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2ac1-19c8-4b76-b07e-424a036c0363 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:22.831369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2ac1-19c8-4b76-b07e-424a036c0363 None admin] PATH_INFO: `/v3/users/44afc3a8ac504002a8ef0f343c4f4895` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:22.832468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e2ac1-19c8-4b76-b07e-424a036c0363 None admin] RBAC: Authorizing `identity:get_user(user_id=44afc3a8ac504002a8ef0f343c4f4895)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:22.833897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e2ac1-19c8-4b76-b07e-424a036c0363 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:22.835458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 603/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Aug 19 15:11:22 2022] GET /identity/v3/users/44afc3a8ac504002a8ef0f343c4f4895 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:22.841631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229035b-c9a2-469b-a25d-89e7419a1323 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:22.936303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229035b-c9a2-469b-a25d-89e7419a1323 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:22.948173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:22.969955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1308-f692-4b53-8b38-7bb8d356a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:22.970651 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1308-f692-4b53-8b38-7bb8d356a877 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:22.970929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1308-f692-4b53-8b38-7bb8d356a877 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:22.971200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1308-f692-4b53-8b38-7bb8d356a877 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:23.035135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1308-f692-4b53-8b38-7bb8d356a877 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:23.036555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1308-f692-4b53-8b38-7bb8d356a877 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:23.129373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 595/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:11:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:11:23.135062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2ac1-19c8-4b76-b07e-424a036c0363 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:23.160502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:23.232786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2ac1-19c8-4b76-b07e-424a036c0363 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:23.265020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9abef-c21c-4875-bf47-5b472a1f10c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:23.265636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9abef-c21c-4875-bf47-5b472a1f10c2 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:23.265917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9abef-c21c-4875-bf47-5b472a1f10c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:23.266216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9abef-c21c-4875-bf47-5b472a1f10c2 None admin] PATH_INFO: `/v3/projects/abc17831e25740a5a4b03826fd00a6e0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:23.267311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9abef-c21c-4875-bf47-5b472a1f10c2 None admin] RBAC: Authorizing `identity:get_project(project_id=abc17831e25740a5a4b03826fd00a6e0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:23.268728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9abef-c21c-4875-bf47-5b472a1f10c2 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:23.270345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 604/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Aug 19 15:11:23 2022] GET /identity/v3/projects/abc17831e25740a5a4b03826fd00a6e0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:23.276196 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1308-f692-4b53-8b38-7bb8d356a877 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:11:23.291967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:23.374344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1308-f692-4b53-8b38-7bb8d356a877 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:11:23.406278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c222c-536f-4573-9391-802696be4d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:11:23.406857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c222c-536f-4573-9391-802696be4d78 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:11:23.407131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c222c-536f-4573-9391-802696be4d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:11:23.407397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c222c-536f-4573-9391-802696be4d78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:11:23.408106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c222c-536f-4573-9391-802696be4d78 None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=abc17831e25740a5a4b03826fd00a6e0, user.id=44afc3a8ac504002a8ef0f343c4f4895) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:11:23.408408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c222c-536f-4573-9391-802696be4d78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:11:23.409803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c222c-536f-4573-9391-802696be4d78 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:11:23.415253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 596/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:11:23 2022] GET /identity/v3/role_assignments?user.id=44afc3a8ac504002a8ef0f343c4f4895&scope.project.id=abc17831e25740a5a4b03826fd00a6e0&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:11:33.260925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=54 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:11:33.412762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=62 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:17.989458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b9d4-0230-4f03-b99f-1c550f2c79ed None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:17.990072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b9d4-0230-4f03-b99f-1c550f2c79ed None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:17.990072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4b9d4-0230-4f03-b99f-1c550f2c79ed None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:17.991280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 605/1201] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:12:17.997512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117ec1-1c8a-446c-93a4-8466bf6fb0c1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:17.997968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117ec1-1c8a-446c-93a4-8466bf6fb0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:17.998093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6117ec1-1c8a-446c-93a4-8466bf6fb0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:18.022879 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e6117ec1-1c8a-446c-93a4-8466bf6fb0c1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:12:18.024388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e6117ec1-1c8a-446c-93a4-8466bf6fb0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:12:18.130113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 597/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:12:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:12:18.406330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4b9d4-0230-4f03-b99f-1c550f2c79ed None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:18.532108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4b9d4-0230-4f03-b99f-1c550f2c79ed None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:18.579097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a3fad-29c3-4fa5-b416-9962efe32534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:18.579733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3fad-29c3-4fa5-b416-9962efe32534 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:18.583734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3fad-29c3-4fa5-b416-9962efe32534 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:18.583734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a3fad-29c3-4fa5-b416-9962efe32534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:18.596385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a3fad-29c3-4fa5-b416-9962efe32534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:18.597922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a3fad-29c3-4fa5-b416-9962efe32534 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-a67a3fad-29c3-4fa5-b416-9962efe32534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:18.616406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:18.617550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:18.618562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:18.618562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:18.618562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:18.618562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 606/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:18.623859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6117ec1-1c8a-446c-93a4-8466bf6fb0c1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:18.744739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6117ec1-1c8a-446c-93a4-8466bf6fb0c1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:18.777558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:18.785991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db439122-27ae-451e-8284-2b86879c2cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:18.786685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439122-27ae-451e-8284-2b86879c2cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:18.786966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439122-27ae-451e-8284-2b86879c2cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:18.787237 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db439122-27ae-451e-8284-2b86879c2cb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:18.787889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db439122-27ae-451e-8284-2b86879c2cb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:18.788466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db439122-27ae-451e-8284-2b86879c2cb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:18.789580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db439122-27ae-451e-8284-2b86879c2cb9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:18.805617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 598/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:12:18.812296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a3fad-29c3-4fa5-b416-9962efe32534 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:18.889499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:18.978546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a3fad-29c3-4fa5-b416-9962efe32534 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:19.016059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934c3d6-0ffd-4993-8652-6dad804cdb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:19.016831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934c3d6-0ffd-4993-8652-6dad804cdb47 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:19.016946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934c3d6-0ffd-4993-8652-6dad804cdb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:19.017229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934c3d6-0ffd-4993-8652-6dad804cdb47 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:19.017867 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934c3d6-0ffd-4993-8652-6dad804cdb47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:19.019361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934c3d6-0ffd-4993-8652-6dad804cdb47 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:19.048239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 607/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Aug 19 15:12:18 2022] POST /identity/v3/users => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:12:21.270378 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910994d5-361a-409e-95b5-ba9a4a335e6e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:21.271050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910994d5-361a-409e-95b5-ba9a4a335e6e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:21.271050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910994d5-361a-409e-95b5-ba9a4a335e6e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:21.272678 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 599/1206] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:12:21.282064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6f59-a21f-42d0-9b56-cf42fc56326d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:21.282064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6f59-a21f-42d0-9b56-cf42fc56326d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:21.282064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6f59-a21f-42d0-9b56-cf42fc56326d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:21.302699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f0cd6f59-a21f-42d0-9b56-cf42fc56326d None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:12:21.304107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f0cd6f59-a21f-42d0-9b56-cf42fc56326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:12:21.377554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 608/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:12:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:12:21.656528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910994d5-361a-409e-95b5-ba9a4a335e6e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:21.781148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910994d5-361a-409e-95b5-ba9a4a335e6e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:21.818961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5359d7-d339-4b4a-94e0-98f91eb78aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:21.818961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5359d7-d339-4b4a-94e0-98f91eb78aff None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:21.819280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5359d7-d339-4b4a-94e0-98f91eb78aff None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:21.819403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5359d7-d339-4b4a-94e0-98f91eb78aff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:21.830971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5359d7-d339-4b4a-94e0-98f91eb78aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-ff5359d7-d339-4b4a-94e0-98f91eb78aff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:12:21.835712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:21.837319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:12:21.838644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:21.845413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 600/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:12:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:21.845622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd6f59-a21f-42d0-9b56-cf42fc56326d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:21.888148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:21.957932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd6f59-a21f-42d0-9b56-cf42fc56326d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:21.995020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d4a92-3e40-4500-a32d-d7d21bdffe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:21.996149 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d4a92-3e40-4500-a32d-d7d21bdffe89 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:21.996426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d4a92-3e40-4500-a32d-d7d21bdffe89 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:21.996697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d4a92-3e40-4500-a32d-d7d21bdffe89 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:21.997365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d4a92-3e40-4500-a32d-d7d21bdffe89 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:21.997668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d4a92-3e40-4500-a32d-d7d21bdffe89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:21.999074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d4a92-3e40-4500-a32d-d7d21bdffe89 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:22.007436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 609/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:12:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:22.013656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5359d7-d339-4b4a-94e0-98f91eb78aff None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:22.072940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:22.135389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5359d7-d339-4b4a-94e0-98f91eb78aff None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:22.175312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fe97-e539-4fe6-8c8f-523baa2c24d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:22.176002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fe97-e539-4fe6-8c8f-523baa2c24d6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:22.176285 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fe97-e539-4fe6-8c8f-523baa2c24d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:22.176560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fe97-e539-4fe6-8c8f-523baa2c24d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:22.188745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8fe97-e539-4fe6-8c8f-523baa2c24d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:22.190414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8fe97-e539-4fe6-8c8f-523baa2c24d6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-daf8fe97-e539-4fe6-8c8f-523baa2c24d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:22.207300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:22.208851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:22.210688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:22.210688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:22.210688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:22.210688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 601/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:22.214524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d4a92-3e40-4500-a32d-d7d21bdffe89 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:22.333371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:22.336194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d4a92-3e40-4500-a32d-d7d21bdffe89 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:22.381619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22c37-3337-4f42-8e4b-c2b004791a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:22.382301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22c37-3337-4f42-8e4b-c2b004791a90 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:22.382578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22c37-3337-4f42-8e4b-c2b004791a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:22.382846 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22c37-3337-4f42-8e4b-c2b004791a90 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:22.383513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd22c37-3337-4f42-8e4b-c2b004791a90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:22.383919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd22c37-3337-4f42-8e4b-c2b004791a90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:22.385192 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd22c37-3337-4f42-8e4b-c2b004791a90 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:22.398485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 610/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:22.405141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fe97-e539-4fe6-8c8f-523baa2c24d6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:22.533743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fe97-e539-4fe6-8c8f-523baa2c24d6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:22.535775 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:22.573050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbb50f-fa99-4b55-86d6-2593162c0531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:22.573842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbb50f-fa99-4b55-86d6-2593162c0531 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:22.574291 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbb50f-fa99-4b55-86d6-2593162c0531 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:22.575640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbb50f-fa99-4b55-86d6-2593162c0531 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:22.583120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbb50f-fa99-4b55-86d6-2593162c0531 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:22.584841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbb50f-fa99-4b55-86d6-2593162c0531 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-27fbb50f-fa99-4b55-86d6-2593162c0531 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:12:22.597639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:22.599119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:22.600185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:22.600185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:22.600185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:12:22.600185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:12:22.600185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:12:22.600185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:12:22.600185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:12:22.600185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:12:22.600185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:22.600185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:22.605876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 602/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:12:22.607480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22c37-3337-4f42-8e4b-c2b004791a90 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:22.735004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22c37-3337-4f42-8e4b-c2b004791a90 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:22.775632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf292984-e95c-4f13-8963-dfd074600174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:22.776249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292984-e95c-4f13-8963-dfd074600174 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:22.777064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292984-e95c-4f13-8963-dfd074600174 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:22.777371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292984-e95c-4f13-8963-dfd074600174 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:22.778165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf292984-e95c-4f13-8963-dfd074600174 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:22.778554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf292984-e95c-4f13-8963-dfd074600174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:22.780025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf292984-e95c-4f13-8963-dfd074600174 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:22.801272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 611/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 19 15:12:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:22.806724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbb50f-fa99-4b55-86d6-2593162c0531 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:22.930845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbb50f-fa99-4b55-86d6-2593162c0531 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:22.972722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ad96b-7854-4a09-8350-6baaec024b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:22.973382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ad96b-7854-4a09-8350-6baaec024b09 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:22.973640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ad96b-7854-4a09-8350-6baaec024b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:22.973941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ad96b-7854-4a09-8350-6baaec024b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:23.006633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:23.064791 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ad96b-7854-4a09-8350-6baaec024b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:23.066283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ad96b-7854-4a09-8350-6baaec024b09 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:23.181036 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 603/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:12:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:12:23.186776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf292984-e95c-4f13-8963-dfd074600174 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:23.209331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:23.303115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf292984-e95c-4f13-8963-dfd074600174 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:23.341639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727709-7e45-4961-8a59-0401e813038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:23.342326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727709-7e45-4961-8a59-0401e813038d None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:23.342582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727709-7e45-4961-8a59-0401e813038d None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:23.342859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727709-7e45-4961-8a59-0401e813038d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:23.353385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2727709-7e45-4961-8a59-0401e813038d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:23.355611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2727709-7e45-4961-8a59-0401e813038d None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-c2727709-7e45-4961-8a59-0401e813038d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:23.371565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:23.372579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:23.373505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:23.373505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:23.373505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:23.373505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 612/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:23.378417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ad96b-7854-4a09-8350-6baaec024b09 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:23.441517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:23.485732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ad96b-7854-4a09-8350-6baaec024b09 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:23.520363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b342d-55a4-4deb-9f21-8a99162cafc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:23.520976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b342d-55a4-4deb-9f21-8a99162cafc9 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:23.521257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b342d-55a4-4deb-9f21-8a99162cafc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:23.521532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b342d-55a4-4deb-9f21-8a99162cafc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:23.522205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b342d-55a4-4deb-9f21-8a99162cafc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:23.522541 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b342d-55a4-4deb-9f21-8a99162cafc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:23.525429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b342d-55a4-4deb-9f21-8a99162cafc9 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:23.536250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 604/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:23.541708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727709-7e45-4961-8a59-0401e813038d None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:23.632560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:23.675719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727709-7e45-4961-8a59-0401e813038d None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:23.715061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2bb92-52b9-4364-b93e-6c37fa272ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:23.715629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2bb92-52b9-4364-b93e-6c37fa272ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:23.715902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2bb92-52b9-4364-b93e-6c37fa272ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:23.716183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2bb92-52b9-4364-b93e-6c37fa272ac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:23.722972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2bb92-52b9-4364-b93e-6c37fa272ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:23.724416 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2bb92-52b9-4364-b93e-6c37fa272ac7 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4bb2bb92-52b9-4364-b93e-6c37fa272ac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:12:23.737957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:23.738955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:23.744852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:12:23.744852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:12:23.744852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:12:23.744852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:12:23.744852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:12:23.744852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:12:23.744852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:23.744852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:23.744852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 613/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:12:23.745431 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b342d-55a4-4deb-9f21-8a99162cafc9 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:23.877420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b342d-55a4-4deb-9f21-8a99162cafc9 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:23.906328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:23.925959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce3fa5-45f3-47cc-8685-21dfd204eac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:23.926943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3fa5-45f3-47cc-8685-21dfd204eac2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:23.927294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3fa5-45f3-47cc-8685-21dfd204eac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:23.927630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3fa5-45f3-47cc-8685-21dfd204eac2 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:23.928399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce3fa5-45f3-47cc-8685-21dfd204eac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:23.928775 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce3fa5-45f3-47cc-8685-21dfd204eac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:23.930310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce3fa5-45f3-47cc-8685-21dfd204eac2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:23.944090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 605/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:23.950097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2bb92-52b9-4364-b93e-6c37fa272ac7 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:24.076276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2bb92-52b9-4364-b93e-6c37fa272ac7 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:24.111667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:24.119798 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e7686-6afd-4992-9958-6b2e6e6b14d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:24.120471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7686-6afd-4992-9958-6b2e6e6b14d5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:24.120797 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7686-6afd-4992-9958-6b2e6e6b14d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:24.121114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e7686-6afd-4992-9958-6b2e6e6b14d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:24.121857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e7686-6afd-4992-9958-6b2e6e6b14d5 None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=2862a661174142d69bbdd54ee0289681) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:24.122187 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e7686-6afd-4992-9958-6b2e6e6b14d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:24.123715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e7686-6afd-4992-9958-6b2e6e6b14d5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:24.129992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 614/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:12:23 2022] GET /identity/v3/role_assignments?user.id=2862a661174142d69bbdd54ee0289681&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:26.262892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfd18-bd6b-46f7-a3ff-17b5f1455c3b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:26.263465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfd18-bd6b-46f7-a3ff-17b5f1455c3b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:26.263465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bfd18-bd6b-46f7-a3ff-17b5f1455c3b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:26.264866 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 606/1220] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:12:26.270851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8187c1-f052-4e59-b03d-e1d5034f5689 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:26.271657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8187c1-f052-4e59-b03d-e1d5034f5689 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:26.271657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8187c1-f052-4e59-b03d-e1d5034f5689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:26.297203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ec8187c1-f052-4e59-b03d-e1d5034f5689 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:12:26.298591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ec8187c1-f052-4e59-b03d-e1d5034f5689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:12:26.373500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 615/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:12:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:12:26.641845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bfd18-bd6b-46f7-a3ff-17b5f1455c3b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:26.744607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bfd18-bd6b-46f7-a3ff-17b5f1455c3b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:26.781444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cbce3-dfd2-4642-856f-af101326f190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:26.782123 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cbce3-dfd2-4642-856f-af101326f190 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:26.782405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cbce3-dfd2-4642-856f-af101326f190 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:26.782674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cbce3-dfd2-4642-856f-af101326f190 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:26.793317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cbce3-dfd2-4642-856f-af101326f190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-465cbce3-dfd2-4642-856f-af101326f190 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:12:26.797989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:26.799118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:26.800454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 607/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:12:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:12:26.805176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8187c1-f052-4e59-b03d-e1d5034f5689 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:26.908202 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8187c1-f052-4e59-b03d-e1d5034f5689 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:26.933234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:26.944222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ee2b0-efe5-4576-98c2-b7ff8e7b5e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:26.944831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee2b0-efe5-4576-98c2-b7ff8e7b5e29 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:26.945112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee2b0-efe5-4576-98c2-b7ff8e7b5e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:26.945388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ee2b0-efe5-4576-98c2-b7ff8e7b5e29 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:26.946070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ee2b0-efe5-4576-98c2-b7ff8e7b5e29 None admin] RBAC: Adding query filter params (name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:26.946380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ee2b0-efe5-4576-98c2-b7ff8e7b5e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:26.947742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ee2b0-efe5-4576-98c2-b7ff8e7b5e29 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:26.957183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 616/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:12:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:26.963640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cbce3-dfd2-4642-856f-af101326f190 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:27.009646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:27.076086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cbce3-dfd2-4642-856f-af101326f190 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:27.110708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e22d71-b0ba-41a0-b1fc-04af474970a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:27.111354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e22d71-b0ba-41a0-b1fc-04af474970a6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:27.111609 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e22d71-b0ba-41a0-b1fc-04af474970a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:27.111911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e22d71-b0ba-41a0-b1fc-04af474970a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:27.122647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e22d71-b0ba-41a0-b1fc-04af474970a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:27.124088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e22d71-b0ba-41a0-b1fc-04af474970a6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-22e22d71-b0ba-41a0-b1fc-04af474970a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:27.139046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:27.140204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:27.141286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:27.141286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:27.141286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:27.141286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 608/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:27.146597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ee2b0-efe5-4576-98c2-b7ff8e7b5e29 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:27.247526 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ee2b0-efe5-4576-98c2-b7ff8e7b5e29 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:27.284562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9e647-0991-486b-946e-371101c377b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:27.285216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9e647-0991-486b-946e-371101c377b3 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:27.285546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9e647-0991-486b-946e-371101c377b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:27.285818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9e647-0991-486b-946e-371101c377b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:27.286903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9e647-0991-486b-946e-371101c377b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:27.287411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9e647-0991-486b-946e-371101c377b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:27.289878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9e647-0991-486b-946e-371101c377b3 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:27.308036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 617/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:27.314630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e22d71-b0ba-41a0-b1fc-04af474970a6 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:27.417831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:27.424706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e22d71-b0ba-41a0-b1fc-04af474970a6 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:27.459894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57e702-c712-487d-9c7d-60f55d7e4d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:27.460518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57e702-c712-487d-9c7d-60f55d7e4d43 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:27.460797 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57e702-c712-487d-9c7d-60f55d7e4d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:27.461070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57e702-c712-487d-9c7d-60f55d7e4d43 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:27.468661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57e702-c712-487d-9c7d-60f55d7e4d43 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:27.470110 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57e702-c712-487d-9c7d-60f55d7e4d43 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-4a57e702-c712-487d-9c7d-60f55d7e4d43 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:12:27.482548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:27.483655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:27.484749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:27.484749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:27.484749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:12:27.484749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:12:27.484749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:12:27.484749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:12:27.484749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:12:27.484749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:12:27.484749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:27.484749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:27.484749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 609/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:27.489603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9e647-0991-486b-946e-371101c377b3 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:27.538739 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:27.597009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9e647-0991-486b-946e-371101c377b3 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:27.632411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99027821-022d-4770-a27c-a6c48f9acc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:27.633026 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027821-022d-4770-a27c-a6c48f9acc97 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:27.633331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027821-022d-4770-a27c-a6c48f9acc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:27.633582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027821-022d-4770-a27c-a6c48f9acc97 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:27.634355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99027821-022d-4770-a27c-a6c48f9acc97 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:27.634645 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99027821-022d-4770-a27c-a6c48f9acc97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:27.636643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99027821-022d-4770-a27c-a6c48f9acc97 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:27.659012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 618/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 19 15:12:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:27.660163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57e702-c712-487d-9c7d-60f55d7e4d43 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:27.772412 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57e702-c712-487d-9c7d-60f55d7e4d43 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:27.808558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5973077-85e9-4a86-88f5-9fe24e923a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:27.809179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973077-85e9-4a86-88f5-9fe24e923a4d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:27.809459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973077-85e9-4a86-88f5-9fe24e923a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:27.809731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973077-85e9-4a86-88f5-9fe24e923a4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:27.820161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5973077-85e9-4a86-88f5-9fe24e923a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:27.821643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5973077-85e9-4a86-88f5-9fe24e923a4d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-b5973077-85e9-4a86-88f5-9fe24e923a4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:27.836013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:27.837066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:27.837961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:27.837961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:27.837961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:27.837961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 610/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:27.844043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99027821-022d-4770-a27c-a6c48f9acc97 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:27.953199 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99027821-022d-4770-a27c-a6c48f9acc97 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:27.955550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:27.991278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77a768-09fd-4c26-8f07-5bd1497b0eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:27.991878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77a768-09fd-4c26-8f07-5bd1497b0eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:27.992157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77a768-09fd-4c26-8f07-5bd1497b0eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:27.992426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77a768-09fd-4c26-8f07-5bd1497b0eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:27.993056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77a768-09fd-4c26-8f07-5bd1497b0eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:27.993352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77a768-09fd-4c26-8f07-5bd1497b0eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:27.994725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77a768-09fd-4c26-8f07-5bd1497b0eb5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:28.006559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 619/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:28.012955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5973077-85e9-4a86-88f5-9fe24e923a4d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:28.022753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:28.125891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5973077-85e9-4a86-88f5-9fe24e923a4d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:28.161171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed14c50-9b12-44a6-a8da-80d4d91bbddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:28.161796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed14c50-9b12-44a6-a8da-80d4d91bbddb None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:28.162092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed14c50-9b12-44a6-a8da-80d4d91bbddb None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:28.162368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed14c50-9b12-44a6-a8da-80d4d91bbddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:28.171022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed14c50-9b12-44a6-a8da-80d4d91bbddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:28.172829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed14c50-9b12-44a6-a8da-80d4d91bbddb None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-8ed14c50-9b12-44a6-a8da-80d4d91bbddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:12:28.187394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:28.188316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:28.189220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:12:28.189220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:12:28.189220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:12:28.189220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:12:28.189220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:12:28.189220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:12:28.189220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:28.189220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:28.193852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 611/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:28.194778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77a768-09fd-4c26-8f07-5bd1497b0eb5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:28.309313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77a768-09fd-4c26-8f07-5bd1497b0eb5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:28.346797 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ee81b-6ca8-4401-ac55-5882f5545122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:28.347437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee81b-6ca8-4401-ac55-5882f5545122 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:28.347718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee81b-6ca8-4401-ac55-5882f5545122 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:28.347989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ee81b-6ca8-4401-ac55-5882f5545122 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:28.349348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ee81b-6ca8-4401-ac55-5882f5545122 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:28.349659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ee81b-6ca8-4401-ac55-5882f5545122 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:28.351190 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ee81b-6ca8-4401-ac55-5882f5545122 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:28.364919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 620/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:12:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:12:28.372273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed14c50-9b12-44a6-a8da-80d4d91bbddb None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:28.439894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:28.477787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed14c50-9b12-44a6-a8da-80d4d91bbddb None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:28.512232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db366b-9e0c-42c7-9690-4d60583998a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:28.512878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db366b-9e0c-42c7-9690-4d60583998a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:28.513156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db366b-9e0c-42c7-9690-4d60583998a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:28.513430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db366b-9e0c-42c7-9690-4d60583998a5 None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/2862a661174142d69bbdd54ee0289681/roles/07f9b55cf8dc408984d3e199f474cb91` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:28.527858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db366b-9e0c-42c7-9690-4d60583998a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=2862a661174142d69bbdd54ee0289681, role_id=07f9b55cf8dc408984d3e199f474cb91)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:28.529293 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db366b-9e0c-42c7-9690-4d60583998a5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:28.544744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 612/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:12:28 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/2862a661174142d69bbdd54ee0289681/roles/07f9b55cf8dc408984d3e199f474cb91 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:12:30.525733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f165c-fe3d-434d-a167-de1e1d56dd73 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:30.526820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f165c-fe3d-434d-a167-de1e1d56dd73 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:30.527094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f165c-fe3d-434d-a167-de1e1d56dd73 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:30.528377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 621/1233] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:12:30.534416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98071d-5470-4549-8bb7-f50df92dbf2b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:30.534911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98071d-5470-4549-8bb7-f50df92dbf2b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:30.535243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98071d-5470-4549-8bb7-f50df92dbf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:30.555088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ff98071d-5470-4549-8bb7-f50df92dbf2b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:12:30.556132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ff98071d-5470-4549-8bb7-f50df92dbf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:12:30.631184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 613/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:12:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:12:30.944902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f165c-fe3d-434d-a167-de1e1d56dd73 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:30.975063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:31.081664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f165c-fe3d-434d-a167-de1e1d56dd73 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:31.125852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e50d3b-fa37-404b-bb91-977a4fc73809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:31.126624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e50d3b-fa37-404b-bb91-977a4fc73809 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:31.126850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e50d3b-fa37-404b-bb91-977a4fc73809 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:31.127180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e50d3b-fa37-404b-bb91-977a4fc73809 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:31.142364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e50d3b-fa37-404b-bb91-977a4fc73809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-81e50d3b-fa37-404b-bb91-977a4fc73809 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:12:31.147642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:31.148667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:31.149667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 622/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Aug 19 15:12:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:31.155463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98071d-5470-4549-8bb7-f50df92dbf2b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:31.211157 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:31.279667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98071d-5470-4549-8bb7-f50df92dbf2b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:31.332889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a54eb-cfad-451d-b02f-f9ef42ca1da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:31.333786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a54eb-cfad-451d-b02f-f9ef42ca1da2 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:31.334124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a54eb-cfad-451d-b02f-f9ef42ca1da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:31.334395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a54eb-cfad-451d-b02f-f9ef42ca1da2 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:31.335307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a54eb-cfad-451d-b02f-f9ef42ca1da2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:31.335658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a54eb-cfad-451d-b02f-f9ef42ca1da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:31.337575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a54eb-cfad-451d-b02f-f9ef42ca1da2 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:31.348678 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 614/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Aug 19 15:12:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:31.355085 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e50d3b-fa37-404b-bb91-977a4fc73809 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:31.446997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:31.465172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e50d3b-fa37-404b-bb91-977a4fc73809 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:31.504050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16018d95-8336-4967-80b2-887d7ae15a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:31.504686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16018d95-8336-4967-80b2-887d7ae15a00 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:31.504967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16018d95-8336-4967-80b2-887d7ae15a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:31.505240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16018d95-8336-4967-80b2-887d7ae15a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:31.516094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16018d95-8336-4967-80b2-887d7ae15a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:31.517535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16018d95-8336-4967-80b2-887d7ae15a00 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-16018d95-8336-4967-80b2-887d7ae15a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:31.533116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:31.538671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:31.541185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:31.541185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:31.541185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:31.541185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 623/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:31.541459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a54eb-cfad-451d-b02f-f9ef42ca1da2 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:31.659764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a54eb-cfad-451d-b02f-f9ef42ca1da2 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:31.670320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:31.704335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc27c1-b8b5-4a18-88d7-1cc027cd35e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:31.705421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc27c1-b8b5-4a18-88d7-1cc027cd35e5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:31.705999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc27c1-b8b5-4a18-88d7-1cc027cd35e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:31.706503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc27c1-b8b5-4a18-88d7-1cc027cd35e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:31.707506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc27c1-b8b5-4a18-88d7-1cc027cd35e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:31.708091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc27c1-b8b5-4a18-88d7-1cc027cd35e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:31.710138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc27c1-b8b5-4a18-88d7-1cc027cd35e5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:31.724441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 615/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:31.731076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16018d95-8336-4967-80b2-887d7ae15a00 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:31.850706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16018d95-8336-4967-80b2-887d7ae15a00 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:31.891691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9e87-cb0a-4195-8af3-2268629b6634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:31.892347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9e87-cb0a-4195-8af3-2268629b6634 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:31.892619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9e87-cb0a-4195-8af3-2268629b6634 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:31.892895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9e87-cb0a-4195-8af3-2268629b6634 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:31.895687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:31.902955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce9e87-cb0a-4195-8af3-2268629b6634 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:31.904563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce9e87-cb0a-4195-8af3-2268629b6634 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-75ce9e87-cb0a-4195-8af3-2268629b6634 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:12:31.915625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:31.916629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:31.917625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:31.917625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:31.917625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:12:31.917625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:12:31.917625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:12:31.917625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:12:31.917625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:12:31.917625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:12:31.917625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:31.917625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:31.917625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 624/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:31.925341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc27c1-b8b5-4a18-88d7-1cc027cd35e5 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:32.055723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc27c1-b8b5-4a18-88d7-1cc027cd35e5 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:32.109291 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d7fc4-5b64-4b0c-87ac-c3ef2b6e5534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:32.110220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d7fc4-5b64-4b0c-87ac-c3ef2b6e5534 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:32.110514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d7fc4-5b64-4b0c-87ac-c3ef2b6e5534 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:32.110772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d7fc4-5b64-4b0c-87ac-c3ef2b6e5534 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:32.111500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d7fc4-5b64-4b0c-87ac-c3ef2b6e5534 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:32.111803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d7fc4-5b64-4b0c-87ac-c3ef2b6e5534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:32.113588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d7fc4-5b64-4b0c-87ac-c3ef2b6e5534 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:32.132518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 616/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 19 15:12:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:32.139677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9e87-cb0a-4195-8af3-2268629b6634 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:32.256103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9e87-cb0a-4195-8af3-2268629b6634 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:32.300061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86385568-16bc-4c85-90fe-d04e6e059ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:32.300700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86385568-16bc-4c85-90fe-d04e6e059ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:32.300985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86385568-16bc-4c85-90fe-d04e6e059ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:32.301257 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86385568-16bc-4c85-90fe-d04e6e059ee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:32.377958 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:32.386755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86385568-16bc-4c85-90fe-d04e6e059ee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:32.388564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86385568-16bc-4c85-90fe-d04e6e059ee0 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:32.525686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 625/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:12:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 19 15:12:32.534653 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d7fc4-5b64-4b0c-87ac-c3ef2b6e5534 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:32.565783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:32.660248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d7fc4-5b64-4b0c-87ac-c3ef2b6e5534 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:32.700557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20914529-0f36-4aae-820f-e2c51e6f354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:32.701292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914529-0f36-4aae-820f-e2c51e6f354a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:32.701572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914529-0f36-4aae-820f-e2c51e6f354a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:32.701839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20914529-0f36-4aae-820f-e2c51e6f354a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:32.715884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20914529-0f36-4aae-820f-e2c51e6f354a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:32.718005 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20914529-0f36-4aae-820f-e2c51e6f354a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-20914529-0f36-4aae-820f-e2c51e6f354a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:32.737197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:32.738516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:32.740143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:32.740143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:32.740143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:32.744336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 617/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:32.745563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86385568-16bc-4c85-90fe-d04e6e059ee0 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:32.857213 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:32.866409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86385568-16bc-4c85-90fe-d04e6e059ee0 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:32.907260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f5ef5-59ea-4c65-9227-67360002d5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:32.908455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f5ef5-59ea-4c65-9227-67360002d5bb None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:32.908741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f5ef5-59ea-4c65-9227-67360002d5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:32.909022 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f5ef5-59ea-4c65-9227-67360002d5bb None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:32.909671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f5ef5-59ea-4c65-9227-67360002d5bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:32.910167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f5ef5-59ea-4c65-9227-67360002d5bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:32.912116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f5ef5-59ea-4c65-9227-67360002d5bb None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:32.930240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 626/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:32.936238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20914529-0f36-4aae-820f-e2c51e6f354a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:33.032822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:33.060380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20914529-0f36-4aae-820f-e2c51e6f354a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:33.102505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933eddf-dff2-4742-9ef2-bb097f7546bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:33.103495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933eddf-dff2-4742-9ef2-bb097f7546bd None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:33.103780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933eddf-dff2-4742-9ef2-bb097f7546bd None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:33.104054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933eddf-dff2-4742-9ef2-bb097f7546bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:33.112763 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933eddf-dff2-4742-9ef2-bb097f7546bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:33.114252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933eddf-dff2-4742-9ef2-bb097f7546bd None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e933eddf-dff2-4742-9ef2-bb097f7546bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:12:33.125724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:33.127334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:33.128238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:12:33.128238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:12:33.128238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:12:33.128238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:12:33.128238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:12:33.128238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:12:33.128238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:33.128238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:33.128238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 618/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:33.134987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f5ef5-59ea-4c65-9227-67360002d5bb None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:33.251429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f5ef5-59ea-4c65-9227-67360002d5bb None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:33.288195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bea88f-6ecf-4483-8b15-fdc5f6becc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:33.288808 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bea88f-6ecf-4483-8b15-fdc5f6becc86 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:33.289082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bea88f-6ecf-4483-8b15-fdc5f6becc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:33.289357 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bea88f-6ecf-4483-8b15-fdc5f6becc86 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:33.290142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bea88f-6ecf-4483-8b15-fdc5f6becc86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:33.290443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bea88f-6ecf-4483-8b15-fdc5f6becc86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:33.291985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bea88f-6ecf-4483-8b15-fdc5f6becc86 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:33.304706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 627/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:12:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:33.311510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933eddf-dff2-4742-9ef2-bb097f7546bd None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:33.445664 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933eddf-dff2-4742-9ef2-bb097f7546bd None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:33.489111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da44f06-4115-4c5a-88e5-14b50621edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:33.489785 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da44f06-4115-4c5a-88e5-14b50621edd5 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:33.490100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da44f06-4115-4c5a-88e5-14b50621edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:33.490402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da44f06-4115-4c5a-88e5-14b50621edd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:33.491168 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da44f06-4115-4c5a-88e5-14b50621edd5 None admin] RBAC: Adding query filter params (role.id=07f9b55cf8dc408984d3e199f474cb91, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=2862a661174142d69bbdd54ee0289681) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:33.491519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da44f06-4115-4c5a-88e5-14b50621edd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:33.493040 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da44f06-4115-4c5a-88e5-14b50621edd5 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:33.500731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 619/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:12:33 2022] GET /identity/v3/role_assignments?user.id=2862a661174142d69bbdd54ee0289681&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=07f9b55cf8dc408984d3e199f474cb91 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:35.971795 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46be96-a39d-44a2-be33-50b537f5850d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:35.972303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46be96-a39d-44a2-be33-50b537f5850d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:35.972303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46be96-a39d-44a2-be33-50b537f5850d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:35.973618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 628/1247] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:12:35.981359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d6612-6c6d-4f0e-9c15-a17e5042373d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:35.981860 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d6612-6c6d-4f0e-9c15-a17e5042373d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:35.981976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d6612-6c6d-4f0e-9c15-a17e5042373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:35.990014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:36.007394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3a8d6612-6c6d-4f0e-9c15-a17e5042373d None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:12:36.008738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3a8d6612-6c6d-4f0e-9c15-a17e5042373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:12:36.099341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 620/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:12:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:12:36.398785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46be96-a39d-44a2-be33-50b537f5850d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:36.421078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:36.531407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46be96-a39d-44a2-be33-50b537f5850d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:36.574087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145f250-8934-4d5e-bc79-f1df71bc963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:36.574720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145f250-8934-4d5e-bc79-f1df71bc963b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:36.575003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145f250-8934-4d5e-bc79-f1df71bc963b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:36.575343 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145f250-8934-4d5e-bc79-f1df71bc963b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:36.586472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145f250-8934-4d5e-bc79-f1df71bc963b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-3145f250-8934-4d5e-bc79-f1df71bc963b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:12:36.591774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:36.592835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:36.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 629/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:12:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:36.599178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d6612-6c6d-4f0e-9c15-a17e5042373d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:36.733158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d6612-6c6d-4f0e-9c15-a17e5042373d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:36.771743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:36.778473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de81b0-16f3-435f-b1e6-a98e7b82b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:36.779272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de81b0-16f3-435f-b1e6-a98e7b82b68d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:36.779596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de81b0-16f3-435f-b1e6-a98e7b82b68d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:36.780071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de81b0-16f3-435f-b1e6-a98e7b82b68d None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:36.781159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de81b0-16f3-435f-b1e6-a98e7b82b68d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:36.781675 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de81b0-16f3-435f-b1e6-a98e7b82b68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:36.783956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de81b0-16f3-435f-b1e6-a98e7b82b68d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:36.796427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 621/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:12:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:36.802618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145f250-8934-4d5e-bc79-f1df71bc963b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:36.885172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:36.912001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145f250-8934-4d5e-bc79-f1df71bc963b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:36.955041 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a5e0e-1743-419d-bbcf-fb6e590e25a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:36.955678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a5e0e-1743-419d-bbcf-fb6e590e25a5 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:36.955960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a5e0e-1743-419d-bbcf-fb6e590e25a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:36.957593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a5e0e-1743-419d-bbcf-fb6e590e25a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:36.968328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a5e0e-1743-419d-bbcf-fb6e590e25a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:36.970976 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a5e0e-1743-419d-bbcf-fb6e590e25a5 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-537a5e0e-1743-419d-bbcf-fb6e590e25a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:36.994280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:36.996813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:36.997913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:36.997913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:36.997913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:36.997913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 630/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:37.006917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de81b0-16f3-435f-b1e6-a98e7b82b68d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:37.149539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de81b0-16f3-435f-b1e6-a98e7b82b68d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:37.197502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ad4a0-6021-473f-a6c0-0fe1c234e793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:37.198371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ad4a0-6021-473f-a6c0-0fe1c234e793 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:37.198706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ad4a0-6021-473f-a6c0-0fe1c234e793 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:37.199059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ad4a0-6021-473f-a6c0-0fe1c234e793 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:37.199782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ad4a0-6021-473f-a6c0-0fe1c234e793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:37.200091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ad4a0-6021-473f-a6c0-0fe1c234e793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:37.201804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ad4a0-6021-473f-a6c0-0fe1c234e793 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:37.216614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 622/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:37.223648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a5e0e-1743-419d-bbcf-fb6e590e25a5 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:37.372082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a5e0e-1743-419d-bbcf-fb6e590e25a5 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:37.425408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:37.434261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cedd6-7374-438a-8390-485377ff133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:37.434897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cedd6-7374-438a-8390-485377ff133b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:37.435187 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cedd6-7374-438a-8390-485377ff133b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:37.435495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cedd6-7374-438a-8390-485377ff133b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:37.444304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cedd6-7374-438a-8390-485377ff133b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:37.445925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cedd6-7374-438a-8390-485377ff133b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-1b0cedd6-7374-438a-8390-485377ff133b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:12:37.462146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:37.463308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:37.470693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:37.470693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:37.470693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:12:37.470693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:12:37.470693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:12:37.470693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:12:37.470693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:12:37.470693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:12:37.470693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:37.470693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:37.470693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 631/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:37.471971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ad4a0-6021-473f-a6c0-0fe1c234e793 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:37.555571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:37.612317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ad4a0-6021-473f-a6c0-0fe1c234e793 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:37.646139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5bacb-ce54-46a2-a0e1-1ea8f25d2746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:37.646676 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5bacb-ce54-46a2-a0e1-1ea8f25d2746 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:37.646956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5bacb-ce54-46a2-a0e1-1ea8f25d2746 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:37.647227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5bacb-ce54-46a2-a0e1-1ea8f25d2746 None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:37.647955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5bacb-ce54-46a2-a0e1-1ea8f25d2746 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:37.648260 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5bacb-ce54-46a2-a0e1-1ea8f25d2746 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:37.649677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5bacb-ce54-46a2-a0e1-1ea8f25d2746 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:37.668916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 623/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 19 15:12:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:37.675137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cedd6-7374-438a-8390-485377ff133b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:37.814776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cedd6-7374-438a-8390-485377ff133b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:37.852771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27c3d1-b0d5-4300-8338-dab148fae2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:37.853879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27c3d1-b0d5-4300-8338-dab148fae2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:37.855012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27c3d1-b0d5-4300-8338-dab148fae2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:37.855516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27c3d1-b0d5-4300-8338-dab148fae2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:37.937981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:37.957353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27c3d1-b0d5-4300-8338-dab148fae2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:37.959671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27c3d1-b0d5-4300-8338-dab148fae2e4 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:38.092524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 632/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:12:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:12:38.098955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5bacb-ce54-46a2-a0e1-1ea8f25d2746 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:38.239858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5bacb-ce54-46a2-a0e1-1ea8f25d2746 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:38.257012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:38.293391 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3837975-25a4-48e7-a7c0-c6c55f33bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:38.294412 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837975-25a4-48e7-a7c0-c6c55f33bffe None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:38.294888 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837975-25a4-48e7-a7c0-c6c55f33bffe None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:38.295180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837975-25a4-48e7-a7c0-c6c55f33bffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:38.307188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3837975-25a4-48e7-a7c0-c6c55f33bffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:38.309133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3837975-25a4-48e7-a7c0-c6c55f33bffe None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-d3837975-25a4-48e7-a7c0-c6c55f33bffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:38.324606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:38.325604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:38.326704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:38.326704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:38.326704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:38.326704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 624/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:38.332486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27c3d1-b0d5-4300-8338-dab148fae2e4 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:38.435075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:38.453644 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27c3d1-b0d5-4300-8338-dab148fae2e4 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:38.500890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20f5de-c697-47de-a729-777fcdd45eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:38.501528 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20f5de-c697-47de-a729-777fcdd45eda None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:38.501812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20f5de-c697-47de-a729-777fcdd45eda None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:38.502120 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20f5de-c697-47de-a729-777fcdd45eda None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:38.502794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20f5de-c697-47de-a729-777fcdd45eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:38.503103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20f5de-c697-47de-a729-777fcdd45eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:38.504509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20f5de-c697-47de-a729-777fcdd45eda None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:38.524957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 633/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:38.526316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3837975-25a4-48e7-a7c0-c6c55f33bffe None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:38.635917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3837975-25a4-48e7-a7c0-c6c55f33bffe None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:38.672023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ccd3a-e34c-497b-ab88-0f6b58ba7a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:38.672665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ccd3a-e34c-497b-ab88-0f6b58ba7a5e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:38.672952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ccd3a-e34c-497b-ab88-0f6b58ba7a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:38.673229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ccd3a-e34c-497b-ab88-0f6b58ba7a5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:38.680712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ccd3a-e34c-497b-ab88-0f6b58ba7a5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:38.682282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ccd3a-e34c-497b-ab88-0f6b58ba7a5e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-5a1ccd3a-e34c-497b-ab88-0f6b58ba7a5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:12:38.697486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:38.699364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:38.701230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:12:38.701230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:12:38.701230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:12:38.701230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:12:38.701230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:12:38.701230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:12:38.701230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:38.701230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:38.701230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 625/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:38.705277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20f5de-c697-47de-a729-777fcdd45eda None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:38.849817 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20f5de-c697-47de-a729-777fcdd45eda None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:38.885088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6493dc-8950-435a-97a9-544826ee9833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:38.885725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6493dc-8950-435a-97a9-544826ee9833 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:38.885999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6493dc-8950-435a-97a9-544826ee9833 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:38.886292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6493dc-8950-435a-97a9-544826ee9833 None admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:38.886987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6493dc-8950-435a-97a9-544826ee9833 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:38.887288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6493dc-8950-435a-97a9-544826ee9833 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:38.888703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6493dc-8950-435a-97a9-544826ee9833 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:38.901043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 634/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:38.907240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ccd3a-e34c-497b-ab88-0f6b58ba7a5e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:38.934145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:39.019367 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ccd3a-e34c-497b-ab88-0f6b58ba7a5e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:39.069543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e8247-6b77-48e8-af8a-882a5288c819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:39.070187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e8247-6b77-48e8-af8a-882a5288c819 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:39.070469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e8247-6b77-48e8-af8a-882a5288c819 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:39.070742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e8247-6b77-48e8-af8a-882a5288c819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:39.071468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e8247-6b77-48e8-af8a-882a5288c819 None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=2862a661174142d69bbdd54ee0289681) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:39.071790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e8247-6b77-48e8-af8a-882a5288c819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:39.073220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e8247-6b77-48e8-af8a-882a5288c819 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:39.078963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 626/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:12:38 2022] GET /identity/v3/role_assignments?user.id=2862a661174142d69bbdd54ee0289681&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:41.124548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470209a-6cb2-408b-b9e5-133fefee2047 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:41.125102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470209a-6cb2-408b-b9e5-133fefee2047 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:41.125102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470209a-6cb2-408b-b9e5-133fefee2047 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:41.126477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 635/1261] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:12:41.131434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187658e5-ae23-492b-9cfa-5d42c62167b9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:41.131821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187658e5-ae23-492b-9cfa-5d42c62167b9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:41.131975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187658e5-ae23-492b-9cfa-5d42c62167b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:41.149909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-187658e5-ae23-492b-9cfa-5d42c62167b9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:12:41.151654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-187658e5-ae23-492b-9cfa-5d42c62167b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:12:41.216297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 627/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:12:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:12:41.477545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470209a-6cb2-408b-b9e5-133fefee2047 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:41.489154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:41.592012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470209a-6cb2-408b-b9e5-133fefee2047 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:41.624949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ae81a-0c30-4e8d-bfc4-5710a17de0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:41.625564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ae81a-0c30-4e8d-bfc4-5710a17de0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:41.625843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ae81a-0c30-4e8d-bfc4-5710a17de0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:41.626161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ae81a-0c30-4e8d-bfc4-5710a17de0b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:41.636299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ae81a-0c30-4e8d-bfc4-5710a17de0b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-b08ae81a-0c30-4e8d-bfc4-5710a17de0b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:12:41.640930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:41.641992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:41.643043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 636/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:12:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:41.648091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187658e5-ae23-492b-9cfa-5d42c62167b9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:41.666305 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:41.746118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187658e5-ae23-492b-9cfa-5d42c62167b9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:41.785340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88654816-5bca-4f06-b020-173c729f51a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:41.786136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88654816-5bca-4f06-b020-173c729f51a3 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:41.786577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88654816-5bca-4f06-b020-173c729f51a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:41.786988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88654816-5bca-4f06-b020-173c729f51a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:41.787805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88654816-5bca-4f06-b020-173c729f51a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:41.788325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88654816-5bca-4f06-b020-173c729f51a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:41.789690 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88654816-5bca-4f06-b020-173c729f51a3 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:41.804083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 628/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:12:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:41.806021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ae81a-0c30-4e8d-bfc4-5710a17de0b1 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:41.873323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:41.905018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ae81a-0c30-4e8d-bfc4-5710a17de0b1 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:41.937733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aaff7-6ef5-47f2-8e99-e3356c2f8cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:41.938369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aaff7-6ef5-47f2-8e99-e3356c2f8cfd None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:41.938648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aaff7-6ef5-47f2-8e99-e3356c2f8cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:41.938915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aaff7-6ef5-47f2-8e99-e3356c2f8cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:41.948431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645aaff7-6ef5-47f2-8e99-e3356c2f8cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:41.949856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645aaff7-6ef5-47f2-8e99-e3356c2f8cfd None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-645aaff7-6ef5-47f2-8e99-e3356c2f8cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:41.963711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:41.964773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:41.965676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:41.965676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:41.965676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:41.965676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 637/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:41.970715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88654816-5bca-4f06-b020-173c729f51a3 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:42.049361 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:42.068595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88654816-5bca-4f06-b020-173c729f51a3 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:42.101485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e82383-dffb-4000-abb5-19baeb36734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:42.102112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e82383-dffb-4000-abb5-19baeb36734e None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:42.102390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e82383-dffb-4000-abb5-19baeb36734e None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:42.102659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e82383-dffb-4000-abb5-19baeb36734e None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:42.103559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e82383-dffb-4000-abb5-19baeb36734e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:42.103858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e82383-dffb-4000-abb5-19baeb36734e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:42.105786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e82383-dffb-4000-abb5-19baeb36734e None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:42.125682 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 629/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:42.131650 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aaff7-6ef5-47f2-8e99-e3356c2f8cfd None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:42.235489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aaff7-6ef5-47f2-8e99-e3356c2f8cfd None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:42.254403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:42.269163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306722b5-3f73-47ca-b3d6-fe9a81eb488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:42.269780 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306722b5-3f73-47ca-b3d6-fe9a81eb488e None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:42.270099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306722b5-3f73-47ca-b3d6-fe9a81eb488e None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:42.270379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306722b5-3f73-47ca-b3d6-fe9a81eb488e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:42.277473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306722b5-3f73-47ca-b3d6-fe9a81eb488e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:42.278944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306722b5-3f73-47ca-b3d6-fe9a81eb488e None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-306722b5-3f73-47ca-b3d6-fe9a81eb488e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:12:42.289522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:42.290629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:42.291822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:42.291822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:42.291822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:12:42.291822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:12:42.291822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:12:42.291822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:12:42.291822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:12:42.291822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:12:42.291822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:42.291822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:42.291822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 638/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:42.296669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e82383-dffb-4000-abb5-19baeb36734e None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:42.396065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e82383-dffb-4000-abb5-19baeb36734e None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:42.429233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646cac3-4c6f-42f0-a8fb-0fe32a8413fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:42.429845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646cac3-4c6f-42f0-a8fb-0fe32a8413fc None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:42.430149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646cac3-4c6f-42f0-a8fb-0fe32a8413fc None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:42.430422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646cac3-4c6f-42f0-a8fb-0fe32a8413fc None admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:42.431159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646cac3-4c6f-42f0-a8fb-0fe32a8413fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:42.431465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646cac3-4c6f-42f0-a8fb-0fe32a8413fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:42.433458 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646cac3-4c6f-42f0-a8fb-0fe32a8413fc None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:42.442463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:42.450958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 630/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 19 15:12:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:12:42.456779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306722b5-3f73-47ca-b3d6-fe9a81eb488e None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:42.555728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306722b5-3f73-47ca-b3d6-fe9a81eb488e None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:42.588337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982dc12-4bb9-4ea9-82b5-02f661c2467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:42.588981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982dc12-4bb9-4ea9-82b5-02f661c2467f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:42.589260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982dc12-4bb9-4ea9-82b5-02f661c2467f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:42.589535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982dc12-4bb9-4ea9-82b5-02f661c2467f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:42.599474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982dc12-4bb9-4ea9-82b5-02f661c2467f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:42.600910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982dc12-4bb9-4ea9-82b5-02f661c2467f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-4982dc12-4bb9-4ea9-82b5-02f661c2467f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:42.615148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:42.616222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:42.617112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:42.617112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:42.617112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:42.617112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 639/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:42.622785 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646cac3-4c6f-42f0-a8fb-0fe32a8413fc None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:42.717738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646cac3-4c6f-42f0-a8fb-0fe32a8413fc None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:42.754555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56759927-6bef-45c3-a847-c704be98d504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:42.755223 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56759927-6bef-45c3-a847-c704be98d504 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:42.755523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56759927-6bef-45c3-a847-c704be98d504 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:42.755866 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56759927-6bef-45c3-a847-c704be98d504 None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:42.756645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56759927-6bef-45c3-a847-c704be98d504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:42.756941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56759927-6bef-45c3-a847-c704be98d504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:42.758509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56759927-6bef-45c3-a847-c704be98d504 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:42.771936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 631/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:42.778300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982dc12-4bb9-4ea9-82b5-02f661c2467f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:42.809623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:42.875952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982dc12-4bb9-4ea9-82b5-02f661c2467f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:42.909095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b0296-d7f0-48ab-99d8-58859b7c6315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:42.909713 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0296-d7f0-48ab-99d8-58859b7c6315 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:42.909994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0296-d7f0-48ab-99d8-58859b7c6315 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:42.910292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b0296-d7f0-48ab-99d8-58859b7c6315 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:42.917251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b0296-d7f0-48ab-99d8-58859b7c6315 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:42.918718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b0296-d7f0-48ab-99d8-58859b7c6315 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-264b0296-d7f0-48ab-99d8-58859b7c6315 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:12:42.929435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:42.930510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:42.931518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:12:42.931518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:12:42.931518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:12:42.931518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:12:42.931518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:12:42.931518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:12:42.931518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:42.931518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:42.931518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 640/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:42.936421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56759927-6bef-45c3-a847-c704be98d504 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:42.993501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:43.034558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56759927-6bef-45c3-a847-c704be98d504 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:43.066605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14331c5f-eef5-47f9-a22b-8c583dcca64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:43.067195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331c5f-eef5-47f9-a22b-8c583dcca64b None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:43.067469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331c5f-eef5-47f9-a22b-8c583dcca64b None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:43.067738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14331c5f-eef5-47f9-a22b-8c583dcca64b None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:43.068413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14331c5f-eef5-47f9-a22b-8c583dcca64b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:43.068716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14331c5f-eef5-47f9-a22b-8c583dcca64b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:43.070155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14331c5f-eef5-47f9-a22b-8c583dcca64b None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:43.081600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 632/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:12:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:43.089007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b0296-d7f0-48ab-99d8-58859b7c6315 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:43.182459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:43.191492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b0296-d7f0-48ab-99d8-58859b7c6315 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:43.225219 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99137c02-8012-4e85-8460-594de9567f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:43.225872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137c02-8012-4e85-8460-594de9567f83 None admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:43.226189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137c02-8012-4e85-8460-594de9567f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:43.226458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137c02-8012-4e85-8460-594de9567f83 None admin] PATH_INFO: `/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/2862a661174142d69bbdd54ee0289681/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:43.228573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99137c02-8012-4e85-8460-594de9567f83 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b20bcabf64f4a1e836faac13a949278, user_id=2862a661174142d69bbdd54ee0289681, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:43.230114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99137c02-8012-4e85-8460-594de9567f83 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:43.242293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 641/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Aug 19 15:12:43 2022] PUT /identity/v3/projects/1b20bcabf64f4a1e836faac13a949278/users/2862a661174142d69bbdd54ee0289681/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:12:45.190756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d9d23-d723-4d56-9ae2-7f03f0801ff9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:45.191286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d9d23-d723-4d56-9ae2-7f03f0801ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:45.191286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d9d23-d723-4d56-9ae2-7f03f0801ff9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:45.192747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 633/1274] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:12:45.198152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7ba6-7b0f-4ebe-9df5-799c96cf9497 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:45.198591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7ba6-7b0f-4ebe-9df5-799c96cf9497 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:45.198681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db7ba6-7b0f-4ebe-9df5-799c96cf9497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:45.217121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-47db7ba6-7b0f-4ebe-9df5-799c96cf9497 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:12:45.218350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-47db7ba6-7b0f-4ebe-9df5-799c96cf9497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:12:45.287326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 642/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:12:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:12:45.564269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d9d23-d723-4d56-9ae2-7f03f0801ff9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:45.681689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d9d23-d723-4d56-9ae2-7f03f0801ff9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:45.704511 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:45.730176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecceb-b4ab-4ed2-a99d-4626762be6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:45.731141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecceb-b4ab-4ed2-a99d-4626762be6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:45.731571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecceb-b4ab-4ed2-a99d-4626762be6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:45.732041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ecceb-b4ab-4ed2-a99d-4626762be6d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:45.748413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ecceb-b4ab-4ed2-a99d-4626762be6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-6b2ecceb-b4ab-4ed2-a99d-4626762be6d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 15:12:45.753821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:45.754972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:45.756926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 634/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Aug 19 15:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:45.761444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db7ba6-7b0f-4ebe-9df5-799c96cf9497 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:45.865722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:45.892551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db7ba6-7b0f-4ebe-9df5-799c96cf9497 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:45.928603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7bee0-65c8-4cf9-b950-02fda95cbb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:45.929264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7bee0-65c8-4cf9-b950-02fda95cbb79 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:45.929622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7bee0-65c8-4cf9-b950-02fda95cbb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:45.929941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7bee0-65c8-4cf9-b950-02fda95cbb79 None admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:45.930678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7bee0-65c8-4cf9-b950-02fda95cbb79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:45.931022 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7bee0-65c8-4cf9-b950-02fda95cbb79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:45.932472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7bee0-65c8-4cf9-b950-02fda95cbb79 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:45.940994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 643/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Aug 19 15:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:45.946900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecceb-b4ab-4ed2-a99d-4626762be6d4 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:46.056995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ecceb-b4ab-4ed2-a99d-4626762be6d4 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:46.090606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719a952-2f7d-41b7-8b5f-0da49ccb264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:46.091226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719a952-2f7d-41b7-8b5f-0da49ccb264f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:46.091503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719a952-2f7d-41b7-8b5f-0da49ccb264f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:46.091775 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719a952-2f7d-41b7-8b5f-0da49ccb264f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:46.101422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719a952-2f7d-41b7-8b5f-0da49ccb264f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:46.102881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719a952-2f7d-41b7-8b5f-0da49ccb264f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e719a952-2f7d-41b7-8b5f-0da49ccb264f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:46.117680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:46.118842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:46.120036 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:46.120036 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:46.120036 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:46.120036 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 635/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:46.124698 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7bee0-65c8-4cf9-b950-02fda95cbb79 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:46.238598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7bee0-65c8-4cf9-b950-02fda95cbb79 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:46.276900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d1ad3-4f61-483d-b961-9d2fadda6d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:46.277844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d1ad3-4f61-483d-b961-9d2fadda6d0b None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:46.278331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d1ad3-4f61-483d-b961-9d2fadda6d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:46.278769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d1ad3-4f61-483d-b961-9d2fadda6d0b None admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:46.279826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d1ad3-4f61-483d-b961-9d2fadda6d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:46.280318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d1ad3-4f61-483d-b961-9d2fadda6d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:46.282642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d1ad3-4f61-483d-b961-9d2fadda6d0b None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:46.301462 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 644/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:46.307493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719a952-2f7d-41b7-8b5f-0da49ccb264f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:46.342356 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:46.428276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719a952-2f7d-41b7-8b5f-0da49ccb264f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:46.465066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6f316-f15e-41b1-a186-68fc59904c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:46.465705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6f316-f15e-41b1-a186-68fc59904c5d None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:46.465985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6f316-f15e-41b1-a186-68fc59904c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:46.466288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6f316-f15e-41b1-a186-68fc59904c5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:46.474650 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6f316-f15e-41b1-a186-68fc59904c5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:46.476119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6f316-f15e-41b1-a186-68fc59904c5d None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-e2b6f316-f15e-41b1-a186-68fc59904c5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 15:12:46.489056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:46.490848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:46.492685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:46.492685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:46.492685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 15:12:46.492685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 15:12:46.492685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 15:12:46.492685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 15:12:46.492685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 15:12:46.492685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 15:12:46.492685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 15:12:46.492685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:46.492685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 636/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:12:46.499771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d1ad3-4f61-483d-b961-9d2fadda6d0b None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:46.504305 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:46.642484 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d1ad3-4f61-483d-b961-9d2fadda6d0b None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:46.698686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b29d9-619b-4b88-baa6-d023b8a15928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:46.699581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b29d9-619b-4b88-baa6-d023b8a15928 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:46.700039 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b29d9-619b-4b88-baa6-d023b8a15928 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:46.700484 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b29d9-619b-4b88-baa6-d023b8a15928 None admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:46.701770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b29d9-619b-4b88-baa6-d023b8a15928 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:46.702310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b29d9-619b-4b88-baa6-d023b8a15928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:46.704848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b29d9-619b-4b88-baa6-d023b8a15928 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:46.735484 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 645/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Aug 19 15:12:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:46.742628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6f316-f15e-41b1-a186-68fc59904c5d None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:46.848346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:46.860528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6f316-f15e-41b1-a186-68fc59904c5d None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:46.896832 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2701e-d9d2-4a9b-8887-551a55391c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:46.897438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2701e-d9d2-4a9b-8887-551a55391c9a None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:46.897717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2701e-d9d2-4a9b-8887-551a55391c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:46.897990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2701e-d9d2-4a9b-8887-551a55391c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:46.964521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2701e-d9d2-4a9b-8887-551a55391c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:46.965893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2701e-d9d2-4a9b-8887-551a55391c9a None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:47.062936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:47.073465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 637/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Aug 19 15:12:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 15:12:47.079364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b29d9-619b-4b88-baa6-d023b8a15928 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:47.139629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:47.177368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b29d9-619b-4b88-baa6-d023b8a15928 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:47.210237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658e1ed-16f0-4c46-93e8-80d99ee5306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:47.210861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658e1ed-16f0-4c46-93e8-80d99ee5306f None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:47.211139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658e1ed-16f0-4c46-93e8-80d99ee5306f None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:47.211413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658e1ed-16f0-4c46-93e8-80d99ee5306f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:47.221098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658e1ed-16f0-4c46-93e8-80d99ee5306f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:47.222511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658e1ed-16f0-4c46-93e8-80d99ee5306f None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-d658e1ed-16f0-4c46-93e8-80d99ee5306f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 15:12:47.237259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:47.238451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 15:12:47.239972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 15:12:47.239972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 15:12:47.239972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:47.239972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 646/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:47.244197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2701e-d9d2-4a9b-8887-551a55391c9a None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:47.341880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2701e-d9d2-4a9b-8887-551a55391c9a None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:47.375495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac060373-e6f6-47b7-94b4-fbd2021905ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:47.376101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac060373-e6f6-47b7-94b4-fbd2021905ab None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:47.376375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac060373-e6f6-47b7-94b4-fbd2021905ab None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:47.376644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac060373-e6f6-47b7-94b4-fbd2021905ab None admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:47.377277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac060373-e6f6-47b7-94b4-fbd2021905ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:47.377574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac060373-e6f6-47b7-94b4-fbd2021905ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:47.378956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac060373-e6f6-47b7-94b4-fbd2021905ab None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:47.389876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 638/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Aug 19 15:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:47.395616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658e1ed-16f0-4c46-93e8-80d99ee5306f None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:47.495165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658e1ed-16f0-4c46-93e8-80d99ee5306f None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:47.508323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:47.528689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd677b-a86b-446f-a5a7-8e84d08ffb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:47.529322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd677b-a86b-446f-a5a7-8e84d08ffb22 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:47.529598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd677b-a86b-446f-a5a7-8e84d08ffb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:47.529867 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd677b-a86b-446f-a5a7-8e84d08ffb22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:47.536387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd677b-a86b-446f-a5a7-8e84d08ffb22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:47.537850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd677b-a86b-446f-a5a7-8e84d08ffb22 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application [None req-07fd677b-a86b-446f-a5a7-8e84d08ffb22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 15:12:47.549608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:47.550576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:47.551483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 15:12:47.551483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 15:12:47.551483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 15:12:47.551483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 15:12:47.551483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 15:12:47.551483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 15:12:47.551483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 15:12:47.551483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: ERROR keystone.server.flask.application Aug 19 15:12:47.551483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 647/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Aug 19 15:12:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:47.556594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac060373-e6f6-47b7-94b4-fbd2021905ab None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:47.607925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:47.657684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac060373-e6f6-47b7-94b4-fbd2021905ab None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:47.691549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20408c71-8177-4b56-ac06-01a048513c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:47.692151 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20408c71-8177-4b56-ac06-01a048513c32 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:47.692429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20408c71-8177-4b56-ac06-01a048513c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:47.692700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20408c71-8177-4b56-ac06-01a048513c32 None admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:47.693388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20408c71-8177-4b56-ac06-01a048513c32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:47.693693 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20408c71-8177-4b56-ac06-01a048513c32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:47.695531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20408c71-8177-4b56-ac06-01a048513c32 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:47.707207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 639/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Aug 19 15:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:47.713261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd677b-a86b-446f-a5a7-8e84d08ffb22 None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:47.814477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd677b-a86b-446f-a5a7-8e84d08ffb22 None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:47.846701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd7e2b-3d31-4785-8959-5fe1b51d206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:47.847299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd7e2b-3d31-4785-8959-5fe1b51d206a None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:47.847578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd7e2b-3d31-4785-8959-5fe1b51d206a None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:47.847850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd7e2b-3d31-4785-8959-5fe1b51d206a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:47.848569 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd7e2b-3d31-4785-8959-5fe1b51d206a None admin] RBAC: Adding query filter params (role.id=6247536207ef4c36bdee0e4606d6d73d, scope.project.id=1b20bcabf64f4a1e836faac13a949278, user.id=2862a661174142d69bbdd54ee0289681) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:47.848880 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd7e2b-3d31-4785-8959-5fe1b51d206a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:47.850523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd7e2b-3d31-4785-8959-5fe1b51d206a None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:47.856861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 648/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Aug 19 15:12:47 2022] GET /identity/v3/role_assignments?user.id=2862a661174142d69bbdd54ee0289681&scope.project.id=1b20bcabf64f4a1e836faac13a949278&role.id=6247536207ef4c36bdee0e4606d6d73d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:49.780557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28828e-977b-4571-ae76-559a96349a22 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:49.781109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28828e-977b-4571-ae76-559a96349a22 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:49.781109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28828e-977b-4571-ae76-559a96349a22 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:49.782424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 640/1288] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:12:49.787482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059f61c-b90e-4071-b57a-d0497ec69db0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:49.787916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059f61c-b90e-4071-b57a-d0497ec69db0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:49.788046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059f61c-b90e-4071-b57a-d0497ec69db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:49.805614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c059f61c-b90e-4071-b57a-d0497ec69db0 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:12:49.806793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c059f61c-b90e-4071-b57a-d0497ec69db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:12:49.836182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:49.874445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 649/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:12:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:12:50.139244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28828e-977b-4571-ae76-559a96349a22 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:50.239304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28828e-977b-4571-ae76-559a96349a22 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:50.249998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:50.273003 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48593364-8d69-4d4a-92a4-b88db795af55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:50.273620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48593364-8d69-4d4a-92a4-b88db795af55 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:50.273900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48593364-8d69-4d4a-92a4-b88db795af55 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:50.274202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48593364-8d69-4d4a-92a4-b88db795af55 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:50.274789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48593364-8d69-4d4a-92a4-b88db795af55 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:50.276165 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48593364-8d69-4d4a-92a4-b88db795af55 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-48593364-8d69-4d4a-92a4-b88db795af55 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:50.284524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:50.285737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:50.286640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 641/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 19 15:12:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:50.291721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059f61c-b90e-4071-b57a-d0497ec69db0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:50.388125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059f61c-b90e-4071-b57a-d0497ec69db0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:50.419898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6f4fb-119c-4933-a4c3-c222e0c9d437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:50.420428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f4fb-119c-4933-a4c3-c222e0c9d437 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:50.420704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f4fb-119c-4933-a4c3-c222e0c9d437 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:50.420972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6f4fb-119c-4933-a4c3-c222e0c9d437 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:50.421590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6f4fb-119c-4933-a4c3-c222e0c9d437 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:50.421888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6f4fb-119c-4933-a4c3-c222e0c9d437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:50.423263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6f4fb-119c-4933-a4c3-c222e0c9d437 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:50.427830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 650/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 19 15:12:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:50.433911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48593364-8d69-4d4a-92a4-b88db795af55 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:50.529952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48593364-8d69-4d4a-92a4-b88db795af55 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:50.561880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544816c-ff81-40e3-a826-bd9a9b04bac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:50.562503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544816c-ff81-40e3-a826-bd9a9b04bac8 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:50.562781 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544816c-ff81-40e3-a826-bd9a9b04bac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:50.563049 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544816c-ff81-40e3-a826-bd9a9b04bac8 None admin] PATH_INFO: `/v3/services` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:50.563682 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544816c-ff81-40e3-a826-bd9a9b04bac8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:50.563963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544816c-ff81-40e3-a826-bd9a9b04bac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:50.565309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544816c-ff81-40e3-a826-bd9a9b04bac8 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:50.569504 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 642/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 19 15:12:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:52.520631 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c56e-d4cc-45bc-9d4e-01826fd32b0f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:52.521277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c56e-d4cc-45bc-9d4e-01826fd32b0f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:52.521277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1c56e-d4cc-45bc-9d4e-01826fd32b0f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:52.522567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 651/1293] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:12:52.527906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7284a-e144-4824-9dc4-702e4c1fbecf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:52.528341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7284a-e144-4824-9dc4-702e4c1fbecf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:52.528448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7284a-e144-4824-9dc4-702e4c1fbecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:52.545875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1ef7284a-e144-4824-9dc4-702e4c1fbecf None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:12:52.547077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1ef7284a-e144-4824-9dc4-702e4c1fbecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:12:52.576148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:52.617290 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 643/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:12:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 15:12:52.900803 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1c56e-d4cc-45bc-9d4e-01826fd32b0f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:52.931981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:53.001071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1c56e-d4cc-45bc-9d4e-01826fd32b0f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:53.033651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdd1c6-12d9-415d-b372-8a9d2284ffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:53.034281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdd1c6-12d9-415d-b372-8a9d2284ffc8 None admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:53.034566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdd1c6-12d9-415d-b372-8a9d2284ffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:53.034838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdd1c6-12d9-415d-b372-8a9d2284ffc8 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:53.035479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdd1c6-12d9-415d-b372-8a9d2284ffc8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:53.036843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdd1c6-12d9-415d-b372-8a9d2284ffc8 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:53.051281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 652/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Aug 19 15:12:52 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:12:55.131285 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cc557-ce5d-4679-8833-22fbaebb536a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:55.131851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cc557-ce5d-4679-8833-22fbaebb536a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:55.131851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cc557-ce5d-4679-8833-22fbaebb536a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:55.133159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 644/1296] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:12:55.139296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204c957-07b2-424f-b8db-72ffd87f24e4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:55.139760 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204c957-07b2-424f-b8db-72ffd87f24e4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:55.139870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204c957-07b2-424f-b8db-72ffd87f24e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:55.161177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4204c957-07b2-424f-b8db-72ffd87f24e4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:12:55.162396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4204c957-07b2-424f-b8db-72ffd87f24e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:12:55.232699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 653/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:12:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:12:55.500599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cc557-ce5d-4679-8833-22fbaebb536a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:55.600203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cc557-ce5d-4679-8833-22fbaebb536a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:55.634575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59629-c421-425a-8398-add57599966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:55.635492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59629-c421-425a-8398-add57599966f None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:55.636546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59629-c421-425a-8398-add57599966f None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:55.636958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d59629-c421-425a-8398-add57599966f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:55.637834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d59629-c421-425a-8398-add57599966f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:55.639897 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d59629-c421-425a-8398-add57599966f None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-88d59629-c421-425a-8398-add57599966f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:55.651273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:55.652459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:55.653405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 645/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 19 15:12:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 15:12:55.659544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204c957-07b2-424f-b8db-72ffd87f24e4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:55.683701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:55.774134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204c957-07b2-424f-b8db-72ffd87f24e4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:55.812098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb24b3-7296-489d-b26f-477c064b346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:55.812704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb24b3-7296-489d-b26f-477c064b346c None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:55.812985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb24b3-7296-489d-b26f-477c064b346c None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:55.813247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb24b3-7296-489d-b26f-477c064b346c None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:55.813881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb24b3-7296-489d-b26f-477c064b346c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:55.814207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb24b3-7296-489d-b26f-477c064b346c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:55.815570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb24b3-7296-489d-b26f-477c064b346c None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:55.820955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 654/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 19 15:12:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:55.827190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59629-c421-425a-8398-add57599966f None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:55.860162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:55.938867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d59629-c421-425a-8398-add57599966f None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:55.975771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525cf45-9b3b-46e4-b1ba-d4b64f2099d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:55.976373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525cf45-9b3b-46e4-b1ba-d4b64f2099d6 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:55.976656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525cf45-9b3b-46e4-b1ba-d4b64f2099d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:55.976930 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525cf45-9b3b-46e4-b1ba-d4b64f2099d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:55.977636 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525cf45-9b3b-46e4-b1ba-d4b64f2099d6 None admin] RBAC: Adding query filter params (interface=public, service_id=adc0e8b90e6c4fd3a61d9d895117f28f, region_id=RegionOne) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:55.978215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525cf45-9b3b-46e4-b1ba-d4b64f2099d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:55.980089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525cf45-9b3b-46e4-b1ba-d4b64f2099d6 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:55.985117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 646/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Aug 19 15:12:55 2022] GET /identity/v3/endpoints?service_id=adc0e8b90e6c4fd3a61d9d895117f28f&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:12:55.991025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb24b3-7296-489d-b26f-477c064b346c None admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:56.079016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:56.108934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb24b3-7296-489d-b26f-477c064b346c None admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:56.143400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28c5f2-9d09-4708-acdf-1bd1e4cb6f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:56.144142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28c5f2-9d09-4708-acdf-1bd1e4cb6f12 None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:56.144290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28c5f2-9d09-4708-acdf-1bd1e4cb6f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:56.144562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28c5f2-9d09-4708-acdf-1bd1e4cb6f12 None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:56.145167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28c5f2-9d09-4708-acdf-1bd1e4cb6f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:56.146568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28c5f2-9d09-4708-acdf-1bd1e4cb6f12 None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:56.153938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 655/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Aug 19 15:12:55 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:12:58.101185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab23bac-d129-4d07-b6f9-f6df891d8e60 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:58.101749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab23bac-d129-4d07-b6f9-f6df891d8e60 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:58.101749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab23bac-d129-4d07-b6f9-f6df891d8e60 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:58.103358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 647/1302] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:12:58.109188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c51c4-ce57-4490-9189-d69241f35609 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:58.109655 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c51c4-ce57-4490-9189-d69241f35609 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:58.109763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c51c4-ce57-4490-9189-d69241f35609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:58.127160 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-df2c51c4-ce57-4490-9189-d69241f35609 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:12:58.128351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df2c51c4-ce57-4490-9189-d69241f35609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:12:58.193360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 656/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:12:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 15:12:58.470662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab23bac-d129-4d07-b6f9-f6df891d8e60 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:58.572180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:58.579912 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab23bac-d129-4d07-b6f9-f6df891d8e60 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:58.614429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca176f-4482-41ba-be41-21974bddd824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:58.615058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca176f-4482-41ba-be41-21974bddd824 None admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:58.615339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca176f-4482-41ba-be41-21974bddd824 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:58.615613 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca176f-4482-41ba-be41-21974bddd824 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:58.616195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca176f-4482-41ba-be41-21974bddd824 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:58.617562 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca176f-4482-41ba-be41-21974bddd824 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application [None req-87ca176f-4482-41ba-be41-21974bddd824 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 15:12:58.626716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 15:12:58.627902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application with Lock( Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self._enter() Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application return self.creator() Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application created_value = creator( Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: ERROR keystone.server.flask.application Aug 19 15:12:58.629012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 648/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Aug 19 15:12:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 15:12:58.633957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c51c4-ce57-4490-9189-d69241f35609 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:58.715810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:12:58.745663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c51c4-ce57-4490-9189-d69241f35609 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:58.782502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fca4d1-4f0d-43a2-bc8a-fb7493317dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:58.783117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca4d1-4f0d-43a2-bc8a-fb7493317dbe None admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:58.783396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca4d1-4f0d-43a2-bc8a-fb7493317dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:58.783669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fca4d1-4f0d-43a2-bc8a-fb7493317dbe None admin] PATH_INFO: `/v3/services` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:58.784307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fca4d1-4f0d-43a2-bc8a-fb7493317dbe None admin] RBAC: Adding query filter params (name=placement) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:12:58.784609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fca4d1-4f0d-43a2-bc8a-fb7493317dbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:58.785971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fca4d1-4f0d-43a2-bc8a-fb7493317dbe None admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:58.791210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 657/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Aug 19 15:12:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:12:58.797644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca176f-4482-41ba-be41-21974bddd824 None admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:12:58.898250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca176f-4482-41ba-be41-21974bddd824 None admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:12:58.931101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b4db7-0d1d-4b11-8193-ac677f1d38c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:12:58.931697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4db7-0d1d-4b11-8193-ac677f1d38c1 None admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:12:58.931974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4db7-0d1d-4b11-8193-ac677f1d38c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:12:58.932244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4db7-0d1d-4b11-8193-ac677f1d38c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:12:58.932919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b4db7-0d1d-4b11-8193-ac677f1d38c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:12:58.934293 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b4db7-0d1d-4b11-8193-ac677f1d38c1 None admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:12:58.953158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 649/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:12:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:13:08.788520 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=30 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:13:08.948984 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:02.326612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e437ff0-6c6c-42b4-9776-5b4615b73182 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:02.327067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e437ff0-6c6c-42b4-9776-5b4615b73182 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:02.327200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e437ff0-6c6c-42b4-9776-5b4615b73182 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:02.333847 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17def2-d84d-4955-9582-7de66b62133a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:02.334279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17def2-d84d-4955-9582-7de66b62133a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:02.334432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17def2-d84d-4955-9582-7de66b62133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:02.339236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 658/1307] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:02.431317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0e17def2-d84d-4955-9582-7de66b62133a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:02.433439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0e17def2-d84d-4955-9582-7de66b62133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:02.590974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 650/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:14:02.881475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea2e6-9087-44cc-b868-08786f9a8223 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:02.881843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea2e6-9087-44cc-b868-08786f9a8223 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:02.882239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ea2e6-9087-44cc-b868-08786f9a8223 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:02.883975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 659/1309] 10.222.0.20 () {54 vars in 965 bytes} [Fri Aug 19 15:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:02.889705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe550a-0069-458f-90f7-f1418e4dad48 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:02.890087 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe550a-0069-458f-90f7-f1418e4dad48 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:02.890438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe550a-0069-458f-90f7-f1418e4dad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:02.969699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cabe550a-0069-458f-90f7-f1418e4dad48 None None] MFA Rules not processed for user `a220cf4fafe84d6498bc959a9cd18df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:02.970960 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cabe550a-0069-458f-90f7-f1418e4dad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:02.993033 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:03.052000 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 651/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Aug 19 15:14:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:03.061347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ea2e6-9087-44cc-b868-08786f9a8223 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:03.063834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-490ea2e6-9087-44cc-b868-08786f9a8223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:03.192295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ea2e6-9087-44cc-b868-08786f9a8223 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:03.277168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6e941-7c20-4d3e-917b-f9a9885679ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:03.277779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6e941-7c20-4d3e-917b-f9a9885679ee service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:03.278081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6e941-7c20-4d3e-917b-f9a9885679ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:03.278359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6e941-7c20-4d3e-917b-f9a9885679ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:03.279995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-93c6e941-7c20-4d3e-917b-f9a9885679ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:03.344198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:03.402491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6e941-7c20-4d3e-917b-f9a9885679ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:03.403932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6e941-7c20-4d3e-917b-f9a9885679ee service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:03.422924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 660/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:05.615800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94156c1-b66c-42de-b374-ce1c0ea74c7d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:05.616406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94156c1-b66c-42de-b374-ce1c0ea74c7d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:05.616406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94156c1-b66c-42de-b374-ce1c0ea74c7d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:05.617891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 652/1312] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:05.623947 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abd16-2ed3-47cb-9971-8f2fa05aad34 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:05.624472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abd16-2ed3-47cb-9971-8f2fa05aad34 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:05.624472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3abd16-2ed3-47cb-9971-8f2fa05aad34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:05.706552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3f3abd16-2ed3-47cb-9971-8f2fa05aad34 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:05.707943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3f3abd16-2ed3-47cb-9971-8f2fa05aad34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:05.823581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 661/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:06.102921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94156c1-b66c-42de-b374-ce1c0ea74c7d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:06.104998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a94156c1-b66c-42de-b374-ce1c0ea74c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:06.211679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94156c1-b66c-42de-b374-ce1c0ea74c7d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:06.282309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:06.285072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1d82b-3d01-4925-b2a0-0c2593e4bae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:06.285708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1d82b-3d01-4925-b2a0-0c2593e4bae9 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:06.285985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1d82b-3d01-4925-b2a0-0c2593e4bae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:06.286314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1d82b-3d01-4925-b2a0-0c2593e4bae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:06.288506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-63f1d82b-3d01-4925-b2a0-0c2593e4bae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:06.397094 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1d82b-3d01-4925-b2a0-0c2593e4bae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:06.398483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1d82b-3d01-4925-b2a0-0c2593e4bae9 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:06.417724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 653/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:08.646725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16bb6b-4596-4419-8eaa-f925856a5c71 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:08.647260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16bb6b-4596-4419-8eaa-f925856a5c71 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:08.647260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16bb6b-4596-4419-8eaa-f925856a5c71 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:08.648623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 662/1315] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:08.654427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b898be-f05e-46b4-a610-876bf21a1aed None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:08.654820 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b898be-f05e-46b4-a610-876bf21a1aed None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:08.654982 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b898be-f05e-46b4-a610-876bf21a1aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:08.719010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-29b898be-f05e-46b4-a610-876bf21a1aed None None] MFA Rules not processed for user `8556ff7ce3fc415290dc56e1f7145ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:08.720229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-29b898be-f05e-46b4-a610-876bf21a1aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:08.771482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:08.815356 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 654/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:09.119852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d1117-ae83-431d-b5ae-f460ade16489 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:09.120135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d1117-ae83-431d-b5ae-f460ade16489 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:09.120414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d1117-ae83-431d-b5ae-f460ade16489 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:09.121748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 663/1317] 10.222.0.20 () {54 vars in 965 bytes} [Fri Aug 19 15:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:09.127719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e086d60-e997-4e0b-abd0-f8f301904071 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:09.128012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e086d60-e997-4e0b-abd0-f8f301904071 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:09.128290 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e086d60-e997-4e0b-abd0-f8f301904071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:09.208372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2e086d60-e997-4e0b-abd0-f8f301904071 None None] MFA Rules not processed for user `a220cf4fafe84d6498bc959a9cd18df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:09.209598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2e086d60-e997-4e0b-abd0-f8f301904071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:09.283909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 655/1318] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Aug 19 15:14:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:09.292787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d1117-ae83-431d-b5ae-f460ade16489 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:09.294355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ce1d1117-ae83-431d-b5ae-f460ade16489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:09.304352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:09.398329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d1117-ae83-431d-b5ae-f460ade16489 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:09.469507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201aa38-32ae-4daa-90fa-18d492ec1e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:09.470134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201aa38-32ae-4daa-90fa-18d492ec1e4a service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:09.470411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201aa38-32ae-4daa-90fa-18d492ec1e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:09.470677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201aa38-32ae-4daa-90fa-18d492ec1e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:09.472263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8201aa38-32ae-4daa-90fa-18d492ec1e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:09.532456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:09.579927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201aa38-32ae-4daa-90fa-18d492ec1e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:09.581394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201aa38-32ae-4daa-90fa-18d492ec1e4a service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:09.601023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 664/1319] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:12.410619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88ffab-6efb-4fcf-9770-7bac66d2dcfd None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:12.411149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88ffab-6efb-4fcf-9770-7bac66d2dcfd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:12.411267 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88ffab-6efb-4fcf-9770-7bac66d2dcfd None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:12.412609 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 656/1320] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:12.417811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea16de-b1f0-4872-b714-8c45711066d3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:12.418267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea16de-b1f0-4872-b714-8c45711066d3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:12.418379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea16de-b1f0-4872-b714-8c45711066d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:12.484723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d6ea16de-b1f0-4872-b714-8c45711066d3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:12.485970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d6ea16de-b1f0-4872-b714-8c45711066d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:12.580338 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 665/1321] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:12.868882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88ffab-6efb-4fcf-9770-7bac66d2dcfd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:12.870600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1c88ffab-6efb-4fcf-9770-7bac66d2dcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:12.920089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:12.972805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88ffab-6efb-4fcf-9770-7bac66d2dcfd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:13.043332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc81e0-e52d-4efd-b6d5-7c763c18d1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:13.043930 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc81e0-e52d-4efd-b6d5-7c763c18d1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:13.044211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc81e0-e52d-4efd-b6d5-7c763c18d1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:13.044484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc81e0-e52d-4efd-b6d5-7c763c18d1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:13.046100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d8dc81e0-e52d-4efd-b6d5-7c763c18d1c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:13.139416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:13.152706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc81e0-e52d-4efd-b6d5-7c763c18d1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:13.154170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc81e0-e52d-4efd-b6d5-7c763c18d1c0 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:13.172093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 657/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:15.788205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee20b6-e953-4492-90d6-304e348fd3a5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:15.788732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee20b6-e953-4492-90d6-304e348fd3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:15.788732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee20b6-e953-4492-90d6-304e348fd3a5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:15.790152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 666/1323] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:15.795921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ed21-d846-406c-a227-2939a02c38c0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:15.796324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ed21-d846-406c-a227-2939a02c38c0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:15.796473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ed21-d846-406c-a227-2939a02c38c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:15.862214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-68b4ed21-d846-406c-a227-2939a02c38c0 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:15.863450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-68b4ed21-d846-406c-a227-2939a02c38c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:15.960331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 658/1324] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:16.240982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee20b6-e953-4492-90d6-304e348fd3a5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:16.242588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-26ee20b6-e953-4492-90d6-304e348fd3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:16.263093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:16.348619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee20b6-e953-4492-90d6-304e348fd3a5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:16.423562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962cbf0-9e36-4c99-b6c2-36fe603f4165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:16.424062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962cbf0-9e36-4c99-b6c2-36fe603f4165 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:16.424340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962cbf0-9e36-4c99-b6c2-36fe603f4165 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:16.424607 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962cbf0-9e36-4c99-b6c2-36fe603f4165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:16.426224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7962cbf0-9e36-4c99-b6c2-36fe603f4165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:16.499085 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:16.537912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962cbf0-9e36-4c99-b6c2-36fe603f4165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:16.539381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962cbf0-9e36-4c99-b6c2-36fe603f4165 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:16.557883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 667/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:18.519028 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955d093-ac96-4a48-a6cc-14f4458f4588 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:18.519553 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955d093-ac96-4a48-a6cc-14f4458f4588 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:18.519647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955d093-ac96-4a48-a6cc-14f4458f4588 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:18.520945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 659/1326] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:18.526429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c0db-2575-4ebf-9eb4-bbb944628059 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:18.526866 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c0db-2575-4ebf-9eb4-bbb944628059 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:18.526966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411c0db-2575-4ebf-9eb4-bbb944628059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:18.592957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a411c0db-2575-4ebf-9eb4-bbb944628059 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:18.594225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a411c0db-2575-4ebf-9eb4-bbb944628059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:18.695535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 668/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:18.983849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955d093-ac96-4a48-a6cc-14f4458f4588 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:18.985431 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c955d093-ac96-4a48-a6cc-14f4458f4588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:19.045052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:19.097377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955d093-ac96-4a48-a6cc-14f4458f4588 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:19.170280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a4a64-1009-4937-a10a-560bda60ee47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:19.170885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a4a64-1009-4937-a10a-560bda60ee47 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:19.171163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a4a64-1009-4937-a10a-560bda60ee47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:19.171431 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a4a64-1009-4937-a10a-560bda60ee47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:19.173019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7d7a4a64-1009-4937-a10a-560bda60ee47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:19.277919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:19.280290 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a4a64-1009-4937-a10a-560bda60ee47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:19.282283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a4a64-1009-4937-a10a-560bda60ee47 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:19.300789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 660/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:21.271966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e573e5-470a-4e8a-a965-cc81007e63e8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:21.272433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e573e5-470a-4e8a-a965-cc81007e63e8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:21.272643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e573e5-470a-4e8a-a965-cc81007e63e8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:21.273904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 669/1329] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:21.279303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ed7b-87f0-43ab-a8de-ca92c417f3c5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:21.279727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ed7b-87f0-43ab-a8de-ca92c417f3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:21.279847 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ed7b-87f0-43ab-a8de-ca92c417f3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:21.350873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-57b6ed7b-87f0-43ab-a8de-ca92c417f3c5 None None] MFA Rules not processed for user `8556ff7ce3fc415290dc56e1f7145ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:21.352089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-57b6ed7b-87f0-43ab-a8de-ca92c417f3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:21.448608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 661/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:21.730842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e573e5-470a-4e8a-a965-cc81007e63e8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:21.732427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f3e573e5-470a-4e8a-a965-cc81007e63e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:21.767154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:21.845928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e573e5-470a-4e8a-a965-cc81007e63e8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:21.917890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b6936-d3e4-44f9-b58c-cce0647484f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:21.918533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b6936-d3e4-44f9-b58c-cce0647484f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:21.918812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b6936-d3e4-44f9-b58c-cce0647484f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:21.919085 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b6936-d3e4-44f9-b58c-cce0647484f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:21.920680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9e0b6936-d3e4-44f9-b58c-cce0647484f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:22.003561 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:22.038900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b6936-d3e4-44f9-b58c-cce0647484f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:22.040335 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b6936-d3e4-44f9-b58c-cce0647484f6 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:22.059073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 670/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:24.205374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498f60d-3010-4752-b7e5-df204070b6ea None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:24.205943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498f60d-3010-4752-b7e5-df204070b6ea None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:24.205943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498f60d-3010-4752-b7e5-df204070b6ea None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:24.207215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 662/1332] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:24.212340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b129-03d2-49d8-9e49-62a2f0d869c2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:24.212741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b129-03d2-49d8-9e49-62a2f0d869c2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:24.212890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b129-03d2-49d8-9e49-62a2f0d869c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:24.278398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-93a7b129-03d2-49d8-9e49-62a2f0d869c2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:24.279599 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-93a7b129-03d2-49d8-9e49-62a2f0d869c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:24.378873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 671/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:24.659814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498f60d-3010-4752-b7e5-df204070b6ea None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:24.661348 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2498f60d-3010-4752-b7e5-df204070b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:24.728476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:24.763536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498f60d-3010-4752-b7e5-df204070b6ea None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:24.834262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e72dc-f5c6-42e0-a93d-35f683c60aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:24.834790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e72dc-f5c6-42e0-a93d-35f683c60aaf service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:24.835068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e72dc-f5c6-42e0-a93d-35f683c60aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:24.835337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e72dc-f5c6-42e0-a93d-35f683c60aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:24.836922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e79e72dc-f5c6-42e0-a93d-35f683c60aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:24.943161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e72dc-f5c6-42e0-a93d-35f683c60aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:24.944583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e72dc-f5c6-42e0-a93d-35f683c60aaf service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:24.954435 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:24.963341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 663/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:26.899677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5760e18-483b-4083-9d7d-e0c3ef35c673 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:26.900231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5760e18-483b-4083-9d7d-e0c3ef35c673 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:26.900231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5760e18-483b-4083-9d7d-e0c3ef35c673 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:26.902167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 672/1335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:26.907179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088121-0406-48b9-b8a2-5157eb9ca334 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:26.907555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088121-0406-48b9-b8a2-5157eb9ca334 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:26.907733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79088121-0406-48b9-b8a2-5157eb9ca334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:26.972593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-79088121-0406-48b9-b8a2-5157eb9ca334 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:26.973786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-79088121-0406-48b9-b8a2-5157eb9ca334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:27.067648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 664/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:27.354781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5760e18-483b-4083-9d7d-e0c3ef35c673 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:27.356318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b5760e18-483b-4083-9d7d-e0c3ef35c673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:27.397130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:27.459503 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5760e18-483b-4083-9d7d-e0c3ef35c673 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:27.530824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619fd1b-7c00-41cc-a94f-2feeaaaa80a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:27.531430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619fd1b-7c00-41cc-a94f-2feeaaaa80a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:27.531704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619fd1b-7c00-41cc-a94f-2feeaaaa80a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:27.531998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619fd1b-7c00-41cc-a94f-2feeaaaa80a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:27.533606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1619fd1b-7c00-41cc-a94f-2feeaaaa80a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:27.617069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:27.642829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619fd1b-7c00-41cc-a94f-2feeaaaa80a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:27.644252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619fd1b-7c00-41cc-a94f-2feeaaaa80a9 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:27.662294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 673/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:29.881363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac835-e222-4d07-9be6-86a8525006f0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:29.881887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac835-e222-4d07-9be6-86a8525006f0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:29.881887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac835-e222-4d07-9be6-86a8525006f0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:29.883334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 665/1338] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:29.888526 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5e1d-3b94-4bc3-a89e-e990bcc929d1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:29.888924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5e1d-3b94-4bc3-a89e-e990bcc929d1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:29.889085 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d5e1d-3b94-4bc3-a89e-e990bcc929d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:29.953190 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1f9d5e1d-3b94-4bc3-a89e-e990bcc929d1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:29.954425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1f9d5e1d-3b94-4bc3-a89e-e990bcc929d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:30.049886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 674/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:30.326880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dac835-e222-4d07-9be6-86a8525006f0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:30.328406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-22dac835-e222-4d07-9be6-86a8525006f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:30.404080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:30.431402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dac835-e222-4d07-9be6-86a8525006f0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:30.502592 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9baf25-57ab-42d0-ae03-a6a89a1e03e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:30.503192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9baf25-57ab-42d0-ae03-a6a89a1e03e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:30.503469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9baf25-57ab-42d0-ae03-a6a89a1e03e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:30.503738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9baf25-57ab-42d0-ae03-a6a89a1e03e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:30.505304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0c9baf25-57ab-42d0-ae03-a6a89a1e03e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:30.612232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9baf25-57ab-42d0-ae03-a6a89a1e03e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:30.613599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9baf25-57ab-42d0-ae03-a6a89a1e03e3 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:30.632090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 666/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:34.428852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ced3-2bf8-4215-8ca7-d9ee84382017 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:34.429366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ced3-2bf8-4215-8ca7-d9ee84382017 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:34.429366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ced3-2bf8-4215-8ca7-d9ee84382017 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:34.430859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 675/1341] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:34.435973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5ce29-fcb9-46fb-afd1-ebdef7ca72a9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:34.436420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5ce29-fcb9-46fb-afd1-ebdef7ca72a9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:34.436510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5ce29-fcb9-46fb-afd1-ebdef7ca72a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:34.442220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:34.502198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e3e5ce29-fcb9-46fb-afd1-ebdef7ca72a9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:34.503424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e3e5ce29-fcb9-46fb-afd1-ebdef7ca72a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:34.603406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 667/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:34.887222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293ced3-2bf8-4215-8ca7-d9ee84382017 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:34.888968 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9293ced3-2bf8-4215-8ca7-d9ee84382017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:34.936859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:34.992466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293ced3-2bf8-4215-8ca7-d9ee84382017 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:35.067337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294808f-85fd-4106-9a28-a815b2ae57ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:35.067968 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294808f-85fd-4106-9a28-a815b2ae57ef service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:35.068245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294808f-85fd-4106-9a28-a815b2ae57ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:35.068512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294808f-85fd-4106-9a28-a815b2ae57ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:35.070112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9294808f-85fd-4106-9a28-a815b2ae57ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:35.160622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:35.176476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294808f-85fd-4106-9a28-a815b2ae57ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:35.177904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294808f-85fd-4106-9a28-a815b2ae57ef service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:35.196236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 676/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:37.757461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e63b3-f98e-4b9d-a523-a2b5640cb98a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:37.758076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e63b3-f98e-4b9d-a523-a2b5640cb98a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:37.758076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e63b3-f98e-4b9d-a523-a2b5640cb98a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:37.759689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 668/1344] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:37.765840 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79626a8-4611-4391-81ae-83db05f9c216 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:37.766366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79626a8-4611-4391-81ae-83db05f9c216 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:37.766472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79626a8-4611-4391-81ae-83db05f9c216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:37.831511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c79626a8-4611-4391-81ae-83db05f9c216 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:37.832659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c79626a8-4611-4391-81ae-83db05f9c216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:37.928726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 677/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:38.213861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e63b3-f98e-4b9d-a523-a2b5640cb98a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:38.215478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d91e63b3-f98e-4b9d-a523-a2b5640cb98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:38.302918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:38.321271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e63b3-f98e-4b9d-a523-a2b5640cb98a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:38.399072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986ea32-751b-4933-99ea-5bf27ae98280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:38.399699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986ea32-751b-4933-99ea-5bf27ae98280 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:38.399982 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986ea32-751b-4933-99ea-5bf27ae98280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:38.400256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986ea32-751b-4933-99ea-5bf27ae98280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:38.402018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a986ea32-751b-4933-99ea-5bf27ae98280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:38.512995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986ea32-751b-4933-99ea-5bf27ae98280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:38.514581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986ea32-751b-4933-99ea-5bf27ae98280 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:38.533254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 669/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:14:42.811519 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbe0ee-143a-48af-bc91-3e6dc538617d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:42.811980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbe0ee-143a-48af-bc91-3e6dc538617d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:42.811980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbe0ee-143a-48af-bc91-3e6dc538617d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:42.813166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 678/1347] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:42.818683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9a59d-92ab-45c9-a2a1-e3b455765677 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:42.819176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9a59d-92ab-45c9-a2a1-e3b455765677 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:42.819293 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9a59d-92ab-45c9-a2a1-e3b455765677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:42.834973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:42.888539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-78f9a59d-92ab-45c9-a2a1-e3b455765677 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:42.889967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-78f9a59d-92ab-45c9-a2a1-e3b455765677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:42.992493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 670/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:43.277132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbe0ee-143a-48af-bc91-3e6dc538617d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:43.278703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e6bbe0ee-143a-48af-bc91-3e6dc538617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:43.334188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:43.381446 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbe0ee-143a-48af-bc91-3e6dc538617d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:43.452775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b715c1-b48c-4273-af62-9ded555204bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:43.453307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b715c1-b48c-4273-af62-9ded555204bd service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:43.453583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b715c1-b48c-4273-af62-9ded555204bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:43.453847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b715c1-b48c-4273-af62-9ded555204bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:43.455455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-08b715c1-b48c-4273-af62-9ded555204bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:43.558631 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:43.562911 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b715c1-b48c-4273-af62-9ded555204bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:43.564340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b715c1-b48c-4273-af62-9ded555204bd service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:43.582710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 679/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:14:48.442192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5d30c-38c7-4276-aa06-29874404ebf1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:48.442633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5d30c-38c7-4276-aa06-29874404ebf1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:48.442727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5d30c-38c7-4276-aa06-29874404ebf1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:48.444207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 671/1350] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:48.449802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f3ef-770e-49b5-b251-a9915b96af90 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:48.450266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f3ef-770e-49b5-b251-a9915b96af90 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:48.450374 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2f3ef-770e-49b5-b251-a9915b96af90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:48.534881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8fb2f3ef-770e-49b5-b251-a9915b96af90 None None] MFA Rules not processed for user `2862a661174142d69bbdd54ee0289681`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:48.536510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8fb2f3ef-770e-49b5-b251-a9915b96af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:48.689679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 680/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:14:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:14:52.696856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304303-e111-48bf-9e4c-31debd59f8ea None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:52.697420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304303-e111-48bf-9e4c-31debd59f8ea None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:52.697420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55304303-e111-48bf-9e4c-31debd59f8ea None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:52.699049 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 672/1352] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:52.704348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c107b6-c698-448e-928f-a2da4145a10b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:52.704811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c107b6-c698-448e-928f-a2da4145a10b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:52.704920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c107b6-c698-448e-928f-a2da4145a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:52.761546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:52.785433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-79c107b6-c698-448e-928f-a2da4145a10b None None] MFA Rules not processed for user `2862a661174142d69bbdd54ee0289681`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:52.786687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-79c107b6-c698-448e-928f-a2da4145a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:52.897427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 681/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:14:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:52.989600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=59 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:54.597336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e2dad-3767-4af1-9438-d78da90bf4bf None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:54.598184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e2dad-3767-4af1-9438-d78da90bf4bf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:54.598184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e2dad-3767-4af1-9438-d78da90bf4bf None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:54.599275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 673/1354] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:54.605098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1383d1-9d43-421a-be77-37c31b86a387 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:54.605504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1383d1-9d43-421a-be77-37c31b86a387 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:54.605723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1383d1-9d43-421a-be77-37c31b86a387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:54.680984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fc1383d1-9d43-421a-be77-37c31b86a387 None None] MFA Rules not processed for user `2862a661174142d69bbdd54ee0289681`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:54.682585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc1383d1-9d43-421a-be77-37c31b86a387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:54.725872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:54.796418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 682/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:14:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:14:58.005245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2f646-86d8-428f-a6c9-b98b95a58215 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:58.005754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2f646-86d8-428f-a6c9-b98b95a58215 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:58.005851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2f646-86d8-428f-a6c9-b98b95a58215 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:58.007159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 674/1356] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:58.012839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad5e7-9445-4aba-965a-2f494ecc1a8d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:58.013251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad5e7-9445-4aba-965a-2f494ecc1a8d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:58.013401 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ad5e7-9445-4aba-965a-2f494ecc1a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:58.088729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ff3ad5e7-9445-4aba-965a-2f494ecc1a8d None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:58.089934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ff3ad5e7-9445-4aba-965a-2f494ecc1a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:58.227863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 683/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:14:58.530062 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e1cf0-bc68-47a7-a633-3fa293d241af None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:58.530862 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e1cf0-bc68-47a7-a633-3fa293d241af None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:58.531382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e1cf0-bc68-47a7-a633-3fa293d241af None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:58.533265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 675/1358] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 19 15:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:14:58.541781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3cf99-aa45-4a89-9737-74d90eaec801 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:58.542597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3cf99-aa45-4a89-9737-74d90eaec801 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:58.543129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3cf99-aa45-4a89-9737-74d90eaec801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:58.566213 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:58.630007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-67b3cf99-aa45-4a89-9737-74d90eaec801 None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:14:58.631243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-67b3cf99-aa45-4a89-9737-74d90eaec801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:58.754653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 684/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 19 15:14:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:14:58.762492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e1cf0-bc68-47a7-a633-3fa293d241af None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:14:58.764092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-173e1cf0-bc68-47a7-a633-3fa293d241af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:58.917910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e1cf0-bc68-47a7-a633-3fa293d241af None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:14:58.993697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:14:59.035984 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c44ed-cc01-466e-aa68-e129e45ee246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:14:59.036657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c44ed-cc01-466e-aa68-e129e45ee246 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:14:59.036940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c44ed-cc01-466e-aa68-e129e45ee246 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:14:59.037063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c44ed-cc01-466e-aa68-e129e45ee246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:14:59.038642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-174c44ed-cc01-466e-aa68-e129e45ee246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:14:59.133709 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c44ed-cc01-466e-aa68-e129e45ee246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:14:59.135913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c44ed-cc01-466e-aa68-e129e45ee246 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:14:59.155767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 676/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:01.274265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ec1ed-3516-4d35-b932-92795f0d3f80 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:01.274858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ec1ed-3516-4d35-b932-92795f0d3f80 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:01.274858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ec1ed-3516-4d35-b932-92795f0d3f80 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:01.278076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 685/1361] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:01.282073 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc4b41-183e-443a-9914-12f8118ad400 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:01.282610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc4b41-183e-443a-9914-12f8118ad400 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:01.282829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc4b41-183e-443a-9914-12f8118ad400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:01.351363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-29fc4b41-183e-443a-9914-12f8118ad400 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:01.352839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-29fc4b41-183e-443a-9914-12f8118ad400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:01.391758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:01.453520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 677/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:01.748920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ec1ed-3516-4d35-b932-92795f0d3f80 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:01.751489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-902ec1ed-3516-4d35-b932-92795f0d3f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:01.822719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:01.911221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ec1ed-3516-4d35-b932-92795f0d3f80 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:02.026843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cab038-fe62-4a99-85b7-88da32637d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:02.027448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cab038-fe62-4a99-85b7-88da32637d91 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:02.027735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cab038-fe62-4a99-85b7-88da32637d91 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:02.027995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cab038-fe62-4a99-85b7-88da32637d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:02.029583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d2cab038-fe62-4a99-85b7-88da32637d91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:02.052838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:02.122876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cab038-fe62-4a99-85b7-88da32637d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:02.124691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cab038-fe62-4a99-85b7-88da32637d91 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:02.146220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 686/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:04.392003 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fe3f6-0f37-407d-911e-13f558bd89f0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:04.392549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fe3f6-0f37-407d-911e-13f558bd89f0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:04.392549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fe3f6-0f37-407d-911e-13f558bd89f0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:04.393875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 678/1364] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:04.399325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffa5b0-cdeb-49ba-b24d-34caaa26cf36 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:04.400696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffa5b0-cdeb-49ba-b24d-34caaa26cf36 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:04.401001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffa5b0-cdeb-49ba-b24d-34caaa26cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:04.485424 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-38ffa5b0-cdeb-49ba-b24d-34caaa26cf36 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:04.486965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-38ffa5b0-cdeb-49ba-b24d-34caaa26cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:04.596117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:04.602458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 687/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:04.897240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a32e7-3c01-4a88-8ff1-08dd0263a9ac None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:04.897858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a32e7-3c01-4a88-8ff1-08dd0263a9ac None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:04.898388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a32e7-3c01-4a88-8ff1-08dd0263a9ac None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:04.900498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 679/1366] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 19 15:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:04.907690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318887e8-f0ed-417e-b29f-2a8cd2a2a425 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:04.908013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318887e8-f0ed-417e-b29f-2a8cd2a2a425 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:04.908418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318887e8-f0ed-417e-b29f-2a8cd2a2a425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:04.992428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-318887e8-f0ed-417e-b29f-2a8cd2a2a425 None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:04.993650 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-318887e8-f0ed-417e-b29f-2a8cd2a2a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:05.122009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 688/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 19 15:15:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:05.130256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a32e7-3c01-4a88-8ff1-08dd0263a9ac None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:05.131839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-db1a32e7-3c01-4a88-8ff1-08dd0263a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:05.288993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a32e7-3c01-4a88-8ff1-08dd0263a9ac None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:05.310679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:05.412896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc899b5-89db-4f32-be56-7f8fb207f750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:05.413560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc899b5-89db-4f32-be56-7f8fb207f750 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:05.413824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc899b5-89db-4f32-be56-7f8fb207f750 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:05.414018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc899b5-89db-4f32-be56-7f8fb207f750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:05.415679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6fc899b5-89db-4f32-be56-7f8fb207f750 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:05.506593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc899b5-89db-4f32-be56-7f8fb207f750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:05.508640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc899b5-89db-4f32-be56-7f8fb207f750 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:05.528454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 680/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:06.232675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597067-83df-4faf-8f26-694a5aa1a1c6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:06.233195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597067-83df-4faf-8f26-694a5aa1a1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:06.233195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597067-83df-4faf-8f26-694a5aa1a1c6 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:06.234514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 689/1369] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:06.239804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88df78-a553-44be-ad01-bcda93c03478 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:06.240080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88df78-a553-44be-ad01-bcda93c03478 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:06.240353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88df78-a553-44be-ad01-bcda93c03478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:06.273489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:06.309862 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7e88df78-a553-44be-ad01-bcda93c03478 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:06.311118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7e88df78-a553-44be-ad01-bcda93c03478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:06.410439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 681/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:07.003718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd28e89-6df5-484a-9cd6-a54226368153 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:07.003718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd28e89-6df5-484a-9cd6-a54226368153 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:07.003718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd28e89-6df5-484a-9cd6-a54226368153 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:07.003718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 690/1371] 10.222.0.20 () {54 vars in 964 bytes} [Fri Aug 19 15:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:07.008254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db84b5-68fc-4fd6-9914-1961f09baea9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:07.008254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db84b5-68fc-4fd6-9914-1961f09baea9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:07.008254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db84b5-68fc-4fd6-9914-1961f09baea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:07.090583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-43db84b5-68fc-4fd6-9914-1961f09baea9 None None] MFA Rules not processed for user `895028dd70a0415595a0ff8ebedb1f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:07.092172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-43db84b5-68fc-4fd6-9914-1961f09baea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:07.141141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:07.180905 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 682/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Aug 19 15:15:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:15:07.188386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd28e89-6df5-484a-9cd6-a54226368153 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:07.189887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6fd28e89-6df5-484a-9cd6-a54226368153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:07.243385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:07.298439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd28e89-6df5-484a-9cd6-a54226368153 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:07.375369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9faf2-9a9b-424a-b7cd-fd583cbf9ae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:07.375947 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9faf2-9a9b-424a-b7cd-fd583cbf9ae7 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:07.376164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9faf2-9a9b-424a-b7cd-fd583cbf9ae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:07.376487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9faf2-9a9b-424a-b7cd-fd583cbf9ae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:07.378013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-42a9faf2-9a9b-424a-b7cd-fd583cbf9ae7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:07.484150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:07.499173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9faf2-9a9b-424a-b7cd-fd583cbf9ae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:07.500981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9faf2-9a9b-424a-b7cd-fd583cbf9ae7 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:07.522865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 691/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:07.526704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31c798-2028-43a4-9717-8fc33af3d3b5 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:07.527102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31c798-2028-43a4-9717-8fc33af3d3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:07.527873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31c798-2028-43a4-9717-8fc33af3d3b5 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:07.530305 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 683/1374] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:15:07.535478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce3754-8e74-43d7-a37b-9bcb615c47a5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:07.535776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce3754-8e74-43d7-a37b-9bcb615c47a5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:07.536031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce3754-8e74-43d7-a37b-9bcb615c47a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:07.610238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-afce3754-8e74-43d7-a37b-9bcb615c47a5 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:07.611299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-afce3754-8e74-43d7-a37b-9bcb615c47a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:07.727670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 692/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:08.017051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31c798-2028-43a4-9717-8fc33af3d3b5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:08.018600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9e31c798-2028-43a4-9717-8fc33af3d3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:08.164337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31c798-2028-43a4-9717-8fc33af3d3b5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:08.217428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:08.282310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85309954-7e57-4c83-a115-4907bc0fc0dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:08.282920 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85309954-7e57-4c83-a115-4907bc0fc0dd service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:08.283202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85309954-7e57-4c83-a115-4907bc0fc0dd service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:08.283477 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85309954-7e57-4c83-a115-4907bc0fc0dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:08.285082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-85309954-7e57-4c83-a115-4907bc0fc0dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:08.377086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85309954-7e57-4c83-a115-4907bc0fc0dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:08.378767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85309954-7e57-4c83-a115-4907bc0fc0dd service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:08.397111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 684/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:10.330587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11db8cf-4b08-4543-944d-d6049a501eb3 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:10.331103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11db8cf-4b08-4543-944d-d6049a501eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:10.331197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11db8cf-4b08-4543-944d-d6049a501eb3 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:10.332494 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 693/1377] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:10.338217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a250af-ac68-4b83-a356-247ea86ab666 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:10.338693 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a250af-ac68-4b83-a356-247ea86ab666 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:10.338800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a250af-ac68-4b83-a356-247ea86ab666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:10.411045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a1a250af-ac68-4b83-a356-247ea86ab666 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:10.412248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a1a250af-ac68-4b83-a356-247ea86ab666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:10.419501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:10.539040 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 685/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:10.831161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11db8cf-4b08-4543-944d-d6049a501eb3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:10.831161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d11db8cf-4b08-4543-944d-d6049a501eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:10.908635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:11.027861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11db8cf-4b08-4543-944d-d6049a501eb3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:11.159291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e8a3f-bff6-4b70-8869-50ae47173676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:11.159974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e8a3f-bff6-4b70-8869-50ae47173676 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:11.160327 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e8a3f-bff6-4b70-8869-50ae47173676 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:11.160673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e8a3f-bff6-4b70-8869-50ae47173676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:11.162404 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f66e8a3f-bff6-4b70-8869-50ae47173676 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:11.181758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:11.255272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e8a3f-bff6-4b70-8869-50ae47173676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:11.256871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e8a3f-bff6-4b70-8869-50ae47173676 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:11.276217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 694/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:13.211425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593473a-2a43-466c-9729-f5cb6beeced2 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:13.211862 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593473a-2a43-466c-9729-f5cb6beeced2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:13.212021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593473a-2a43-466c-9729-f5cb6beeced2 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:13.213784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 686/1380] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:13.220093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08961a0-1d38-4442-95ef-6d049bc6cdf2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:13.220531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08961a0-1d38-4442-95ef-6d049bc6cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:13.220615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08961a0-1d38-4442-95ef-6d049bc6cdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:13.293696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c08961a0-1d38-4442-95ef-6d049bc6cdf2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:13.294944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c08961a0-1d38-4442-95ef-6d049bc6cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:13.390722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:13.398155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 695/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:13.687908 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593473a-2a43-466c-9729-f5cb6beeced2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:13.689625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d593473a-2a43-466c-9729-f5cb6beeced2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:13.847536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:13.859702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593473a-2a43-466c-9729-f5cb6beeced2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:13.979306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca4883-30a4-489c-80fa-140957a67a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:13.980307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca4883-30a4-489c-80fa-140957a67a1e service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:13.980651 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca4883-30a4-489c-80fa-140957a67a1e service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:13.980987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca4883-30a4-489c-80fa-140957a67a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:13.982705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f5ca4883-30a4-489c-80fa-140957a67a1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:14.078215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca4883-30a4-489c-80fa-140957a67a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:14.079907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca4883-30a4-489c-80fa-140957a67a1e service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:14.090721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:14.100047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 687/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:16.050923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e242229-2e93-435f-b855-8a4349f88051 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:16.051479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e242229-2e93-435f-b855-8a4349f88051 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:16.051479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e242229-2e93-435f-b855-8a4349f88051 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:16.052818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 696/1383] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:16.059727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc99618-d986-4846-8540-365c48c6b973 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:16.060131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc99618-d986-4846-8540-365c48c6b973 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:16.060277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc99618-d986-4846-8540-365c48c6b973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:16.136460 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cbc99618-d986-4846-8540-365c48c6b973 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:16.138091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cbc99618-d986-4846-8540-365c48c6b973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:16.252074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 688/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:15:16.540060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e242229-2e93-435f-b855-8a4349f88051 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:16.541637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9e242229-2e93-435f-b855-8a4349f88051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:16.695924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e242229-2e93-435f-b855-8a4349f88051 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:16.765506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:16.814748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fb55f-aafc-437a-bac8-28c0f48d567f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:16.815474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fb55f-aafc-437a-bac8-28c0f48d567f service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:16.815764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fb55f-aafc-437a-bac8-28c0f48d567f service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:16.816114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fb55f-aafc-437a-bac8-28c0f48d567f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:16.818308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d27fb55f-aafc-437a-bac8-28c0f48d567f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:16.924240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fb55f-aafc-437a-bac8-28c0f48d567f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:16.926327 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fb55f-aafc-437a-bac8-28c0f48d567f service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:16.950283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 697/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:18.861097 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8dca6-4933-4973-ab42-ad2426ce50b9 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:18.861607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8dca6-4933-4973-ab42-ad2426ce50b9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:18.861607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8dca6-4933-4973-ab42-ad2426ce50b9 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:18.862941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 689/1386] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:18.868148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa82f2-edda-431f-8c96-771c3179dc58 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:18.869198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa82f2-edda-431f-8c96-771c3179dc58 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:18.869279 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa82f2-edda-431f-8c96-771c3179dc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:18.942229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-65aa82f2-edda-431f-8c96-771c3179dc58 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:18.943741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-65aa82f2-edda-431f-8c96-771c3179dc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:18.983327 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:19.054277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 698/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:19.346327 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8dca6-4933-4973-ab42-ad2426ce50b9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:19.348349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dcc8dca6-4933-4973-ab42-ad2426ce50b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:19.435757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:19.521755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8dca6-4933-4973-ab42-ad2426ce50b9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:19.638455 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd3476-c6a4-4c06-97b9-fb1fc1a29ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:19.638974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd3476-c6a4-4c06-97b9-fb1fc1a29ea7 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:19.639248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd3476-c6a4-4c06-97b9-fb1fc1a29ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:19.639578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd3476-c6a4-4c06-97b9-fb1fc1a29ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:19.641116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a2dd3476-c6a4-4c06-97b9-fb1fc1a29ea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:19.679808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:19.735206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd3476-c6a4-4c06-97b9-fb1fc1a29ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:19.736825 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd3476-c6a4-4c06-97b9-fb1fc1a29ea7 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:19.755337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 690/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:21.710728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd109d-d5d0-46cf-b96d-6a868656096c None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:21.711314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd109d-d5d0-46cf-b96d-6a868656096c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:21.711314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd109d-d5d0-46cf-b96d-6a868656096c None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:21.712644 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 699/1389] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:21.717889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e447-5627-4273-8267-2aa35818a75b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:21.718360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e447-5627-4273-8267-2aa35818a75b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:21.718535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e447-5627-4273-8267-2aa35818a75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:21.782917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-45a3e447-5627-4273-8267-2aa35818a75b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:21.784096 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-45a3e447-5627-4273-8267-2aa35818a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:21.879440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 691/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:15:22.171988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd109d-d5d0-46cf-b96d-6a868656096c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:22.173602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-79cd109d-d5d0-46cf-b96d-6a868656096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:22.319924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd109d-d5d0-46cf-b96d-6a868656096c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:22.336455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:22.433400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afa650-1a56-4766-b401-2707db61fffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:22.433917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afa650-1a56-4766-b401-2707db61fffd service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:22.434224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afa650-1a56-4766-b401-2707db61fffd service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:22.434495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afa650-1a56-4766-b401-2707db61fffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:22.436087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b8afa650-1a56-4766-b401-2707db61fffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:22.502829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83b8e2-5909-423d-a87a-4b890facf6e6 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:22.503111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83b8e2-5909-423d-a87a-4b890facf6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:22.503379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83b8e2-5909-423d-a87a-4b890facf6e6 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:22.504716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 692/1391] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:22.509489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa11a97-d895-42e7-89b8-82b27be8acf8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:22.509765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa11a97-d895-42e7-89b8-82b27be8acf8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:22.510603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa11a97-d895-42e7-89b8-82b27be8acf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:22.525796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:22.532017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afa650-1a56-4766-b401-2707db61fffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:22.533622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afa650-1a56-4766-b401-2707db61fffd service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:22.555573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 700/1392] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:22.579288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7aa11a97-d895-42e7-89b8-82b27be8acf8 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:22.580487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7aa11a97-d895-42e7-89b8-82b27be8acf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:22.686938 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 693/1393] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:15:22.990923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbb07e-096a-441d-9721-a479ec478a05 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:22.991367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbb07e-096a-441d-9721-a479ec478a05 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:22.991590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbb07e-096a-441d-9721-a479ec478a05 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:22.993163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 701/1394] 10.222.0.20 () {54 vars in 967 bytes} [Fri Aug 19 15:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:22.998702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1514b1-ce84-4420-ac1d-84fb8b72d800 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:22.999147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1514b1-ce84-4420-ac1d-84fb8b72d800 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:22.999266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1514b1-ce84-4420-ac1d-84fb8b72d800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:23.073228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bd1514b1-ce84-4420-ac1d-84fb8b72d800 None None] MFA Rules not processed for user `c23bb3a6586247e0a11ece33569d6d69`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:23.074469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bd1514b1-ce84-4420-ac1d-84fb8b72d800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:23.108781 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:23.149447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 694/1395] 10.222.0.20 () {58 vars in 1064 bytes} [Fri Aug 19 15:15:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:23.157444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbb07e-096a-441d-9721-a479ec478a05 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:23.159077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4ccbb07e-096a-441d-9721-a479ec478a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:23.182256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:23.263097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbb07e-096a-441d-9721-a479ec478a05 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:23.340791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0aed35-b0cc-4ce7-a489-3729acdac9bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23bb3a6586247e0a11ece33569d6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:23.341396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aed35-b0cc-4ce7-a489-3729acdac9bb service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:23.341676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aed35-b0cc-4ce7-a489-3729acdac9bb service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:23.341944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0aed35-b0cc-4ce7-a489-3729acdac9bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:23.343567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2f0aed35-b0cc-4ce7-a489-3729acdac9bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:23.415096 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:23.451480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0aed35-b0cc-4ce7-a489-3729acdac9bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:23.452960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0aed35-b0cc-4ce7-a489-3729acdac9bb service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:23.471904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 702/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:24.241972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684cf11-f651-4c15-b2a0-9db46e152ea6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:24.242461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684cf11-f651-4c15-b2a0-9db46e152ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:24.242625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684cf11-f651-4c15-b2a0-9db46e152ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:24.309800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c684cf11-f651-4c15-b2a0-9db46e152ea6 None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:24.311045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c684cf11-f651-4c15-b2a0-9db46e152ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:24.407297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 695/1397] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:24.457196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd8c4-a0d3-465a-bd5d-1377bb7688e7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:24.457741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd8c4-a0d3-465a-bd5d-1377bb7688e7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:24.457741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd8c4-a0d3-465a-bd5d-1377bb7688e7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:24.459337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 703/1398] 10.222.0.20 () {54 vars in 943 bytes} [Fri Aug 19 15:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:24.466507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10ff2-b913-489d-a21b-7cefed1ae35c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:24.466906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10ff2-b913-489d-a21b-7cefed1ae35c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:24.467320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10ff2-b913-489d-a21b-7cefed1ae35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:24.496183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe73d-a60a-4463-987e-6941ad913543 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:24.496502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe73d-a60a-4463-987e-6941ad913543 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:24.497111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8fe73d-a60a-4463-987e-6941ad913543 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:24.498674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 704/1399] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:15:24.503839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934c4b8-7140-475c-8bf8-fb515937a3b2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:24.504124 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934c4b8-7140-475c-8bf8-fb515937a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:24.504396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934c4b8-7140-475c-8bf8-fb515937a3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:24.537068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:24.579674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3934c4b8-7140-475c-8bf8-fb515937a3b2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:24.580957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3934c4b8-7140-475c-8bf8-fb515937a3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:24.676337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4be10ff2-b913-489d-a21b-7cefed1ae35c None None] MFA Rules not processed for user `62c25756d0814f1dbb8ca210ae34c892`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:24.677738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4be10ff2-b913-489d-a21b-7cefed1ae35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:24.693774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 705/1400] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:15:24.786631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 696/1401] 10.222.0.20 () {58 vars in 1040 bytes} [Fri Aug 19 15:15:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:15:24.796481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934c4b8-7140-475c-8bf8-fb515937a3b2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:24.797678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3934c4b8-7140-475c-8bf8-fb515937a3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:24.828960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:24.900517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934c4b8-7140-475c-8bf8-fb515937a3b2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:24.984398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10ff2-b913-489d-a21b-7cefed1ae35c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:24.985708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4be10ff2-b913-489d-a21b-7cefed1ae35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:25.012514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acdc5c-421e-4fee-ab6c-d65b63b62d9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:25.013116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acdc5c-421e-4fee-ab6c-d65b63b62d9f service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:25.013392 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acdc5c-421e-4fee-ab6c-d65b63b62d9f service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:25.013661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acdc5c-421e-4fee-ab6c-d65b63b62d9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:25.015331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-15acdc5c-421e-4fee-ab6c-d65b63b62d9f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:25.064767 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:25.087703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10ff2-b913-489d-a21b-7cefed1ae35c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:25.100653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acdc5c-421e-4fee-ab6c-d65b63b62d9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:25.101059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:25.102564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15acdc5c-421e-4fee-ab6c-d65b63b62d9f service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:25.111073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 706/1402] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:15:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:15:25.209578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95f70b-f8f7-4847-b5af-d66427e00157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:25.210107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95f70b-f8f7-4847-b5af-d66427e00157 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:25.210476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95f70b-f8f7-4847-b5af-d66427e00157 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:25.210639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95f70b-f8f7-4847-b5af-d66427e00157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:25.212464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9c95f70b-f8f7-4847-b5af-d66427e00157 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:25.389967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95f70b-f8f7-4847-b5af-d66427e00157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:25.391608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95f70b-f8f7-4847-b5af-d66427e00157 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:25.411386 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 697/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:27.357913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fe7f3-0366-4a28-81df-d69aee1da601 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:27.358516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fe7f3-0366-4a28-81df-d69aee1da601 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:27.358516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fe7f3-0366-4a28-81df-d69aee1da601 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:27.359903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 707/1404] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:27.367560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920d296-5718-45dd-830b-57db3dc2b5af None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:27.368288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920d296-5718-45dd-830b-57db3dc2b5af None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:27.368288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920d296-5718-45dd-830b-57db3dc2b5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:27.395788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:27.450893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e920d296-5718-45dd-830b-57db3dc2b5af None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:27.452144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e920d296-5718-45dd-830b-57db3dc2b5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:27.566516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 698/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:27.854332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fe7f3-0366-4a28-81df-d69aee1da601 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:27.855856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-844fe7f3-0366-4a28-81df-d69aee1da601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:28.023792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fe7f3-0366-4a28-81df-d69aee1da601 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:28.192052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:28.277216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7c8b0-847d-4b32-8e62-be508a2920c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:28.277839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7c8b0-847d-4b32-8e62-be508a2920c5 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:28.278154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7c8b0-847d-4b32-8e62-be508a2920c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:28.278426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7c8b0-847d-4b32-8e62-be508a2920c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:28.280026 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00a7c8b0-847d-4b32-8e62-be508a2920c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:28.382159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7c8b0-847d-4b32-8e62-be508a2920c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:28.384544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7c8b0-847d-4b32-8e62-be508a2920c5 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:28.406586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 708/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:30.388030 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53571b9-2310-42bf-9e8f-de23191db274 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:30.389952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53571b9-2310-42bf-9e8f-de23191db274 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:30.390779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53571b9-2310-42bf-9e8f-de23191db274 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:30.392770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 699/1407] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:15:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:30.398541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc45093-6a3f-425b-a1e6-a6dec66e9270 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:30.399742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc45093-6a3f-425b-a1e6-a6dec66e9270 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:30.400229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc45093-6a3f-425b-a1e6-a6dec66e9270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:30.481518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:30.492450 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4fc45093-6a3f-425b-a1e6-a6dec66e9270 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:30.496130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4fc45093-6a3f-425b-a1e6-a6dec66e9270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:30.609668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 709/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:30.907316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53571b9-2310-42bf-9e8f-de23191db274 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:30.909098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a53571b9-2310-42bf-9e8f-de23191db274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:31.007674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:31.070474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53571b9-2310-42bf-9e8f-de23191db274 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:31.203048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd1a02-58fc-43ba-a5ed-59e624a076fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:31.203695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd1a02-58fc-43ba-a5ed-59e624a076fc service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:31.204053 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd1a02-58fc-43ba-a5ed-59e624a076fc service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:31.204398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd1a02-58fc-43ba-a5ed-59e624a076fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:31.206109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bfbd1a02-58fc-43ba-a5ed-59e624a076fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:31.270594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:31.304936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd1a02-58fc-43ba-a5ed-59e624a076fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:31.307266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd1a02-58fc-43ba-a5ed-59e624a076fc service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:31.326976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 700/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:40.607745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=44 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:41.324255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=19 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:47.288499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e1e97-721d-40d9-aa99-bf8e53d53896 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:47.289060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e1e97-721d-40d9-aa99-bf8e53d53896 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:47.289060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e1e97-721d-40d9-aa99-bf8e53d53896 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:47.290459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 710/1410] 10.222.0.20 () {54 vars in 918 bytes} [Fri Aug 19 15:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:47.295712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53979ad-c435-4828-ba9d-e1efeae1b5ac None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:47.296092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53979ad-c435-4828-ba9d-e1efeae1b5ac None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:47.296279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53979ad-c435-4828-ba9d-e1efeae1b5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:47.372927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e53979ad-c435-4828-ba9d-e1efeae1b5ac None None] MFA Rules not processed for user `2862a661174142d69bbdd54ee0289681`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:47.374175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e53979ad-c435-4828-ba9d-e1efeae1b5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:47.485201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 701/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Aug 19 15:15:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:47.499451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9919d0-aa13-456a-93e0-694ccfd2f6d9 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:47.499741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9919d0-aa13-456a-93e0-694ccfd2f6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:47.500025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9919d0-aa13-456a-93e0-694ccfd2f6d9 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:47.501351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 711/1412] 10.222.0.20 () {54 vars in 918 bytes} [Fri Aug 19 15:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:47.506307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711392-61db-48e4-be12-ba6ae3d570d4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:47.506596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711392-61db-48e4-be12-ba6ae3d570d4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:47.506872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6711392-61db-48e4-be12-ba6ae3d570d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:47.585316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:47.588045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f6711392-61db-48e4-be12-ba6ae3d570d4 None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:47.589796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f6711392-61db-48e4-be12-ba6ae3d570d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:47.710359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 702/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Aug 19 15:15:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:15:50.077799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4fa6a-5996-4404-ad8d-8ae25497c69a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:50.078393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4fa6a-5996-4404-ad8d-8ae25497c69a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:50.078393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4fa6a-5996-4404-ad8d-8ae25497c69a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:50.079996 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:50.085301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b755d7-6ac0-45d3-8946-9d49a68df11f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:50.085728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b755d7-6ac0-45d3-8946-9d49a68df11f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:50.085837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b755d7-6ac0-45d3-8946-9d49a68df11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:50.152110 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-15b755d7-6ac0-45d3-8946-9d49a68df11f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:50.153316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-15b755d7-6ac0-45d3-8946-9d49a68df11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:50.210519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:50.252091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:50.537923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4fa6a-5996-4404-ad8d-8ae25497c69a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:50.539688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5ba4fa6a-5996-4404-ad8d-8ae25497c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:50.684833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4fa6a-5996-4404-ad8d-8ae25497c69a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:50.755465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:50.795288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91361a08-566d-40dc-b7b1-93011da56294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:50.795798 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91361a08-566d-40dc-b7b1-93011da56294 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:50.796076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91361a08-566d-40dc-b7b1-93011da56294 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:50.796348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91361a08-566d-40dc-b7b1-93011da56294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:50.797948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-91361a08-566d-40dc-b7b1-93011da56294 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:50.885272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91361a08-566d-40dc-b7b1-93011da56294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:50.886887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91361a08-566d-40dc-b7b1-93011da56294 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:50.904590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 713/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:51.783655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4945-cacc-48e3-bc9d-73a0b35b33bb None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:51.784249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4945-cacc-48e3-bc9d-73a0b35b33bb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:51.784249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4945-cacc-48e3-bc9d-73a0b35b33bb None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:51.785601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:51.790382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79026dd7-2161-479e-9a8d-897b2b67eadd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:51.791355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79026dd7-2161-479e-9a8d-897b2b67eadd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:51.791462 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79026dd7-2161-479e-9a8d-897b2b67eadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:51.865418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-79026dd7-2161-479e-9a8d-897b2b67eadd None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:51.866692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-79026dd7-2161-479e-9a8d-897b2b67eadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:51.892791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:51.960698 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:52.122642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c4945-cacc-48e3-bc9d-73a0b35b33bb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:52.124110 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fa6c4945-cacc-48e3-bc9d-73a0b35b33bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:52.268401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c4945-cacc-48e3-bc9d-73a0b35b33bb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:52.305992 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:52.379191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f90818-f302-4930-997c-1110cb4329b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:52.379719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90818-f302-4930-997c-1110cb4329b1 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:52.379996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90818-f302-4930-997c-1110cb4329b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:52.380264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f90818-f302-4930-997c-1110cb4329b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:52.381852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-72f90818-f302-4930-997c-1110cb4329b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:52.472941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90818-f302-4930-997c-1110cb4329b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:52.474554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f90818-f302-4930-997c-1110cb4329b1 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:52.493226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 705/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:53.376705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f0c00-3e02-4a07-a3e0-50f0380d6616 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:53.377288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f0c00-3e02-4a07-a3e0-50f0380d6616 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:53.377288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f0c00-3e02-4a07-a3e0-50f0380d6616 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:53.378684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:53.383638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190e5a1-3d02-4775-9b33-e3d4c599fb2c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:53.384053 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190e5a1-3d02-4775-9b33-e3d4c599fb2c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:53.384178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190e5a1-3d02-4775-9b33-e3d4c599fb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:53.439697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:53.461753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8190e5a1-3d02-4775-9b33-e3d4c599fb2c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:53.463536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8190e5a1-3d02-4775-9b33-e3d4c599fb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:53.559209 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:53.709609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f0c00-3e02-4a07-a3e0-50f0380d6616 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:53.711081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6f2f0c00-3e02-4a07-a3e0-50f0380d6616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:53.857357 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f0c00-3e02-4a07-a3e0-50f0380d6616 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:53.871685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:53.969900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69eb108-7a86-4f88-8b68-71111071cf0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:53.970462 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb108-7a86-4f88-8b68-71111071cf0b service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:53.970740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb108-7a86-4f88-8b68-71111071cf0b service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:53.971012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69eb108-7a86-4f88-8b68-71111071cf0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:53.972597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e69eb108-7a86-4f88-8b68-71111071cf0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:54.059596 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69eb108-7a86-4f88-8b68-71111071cf0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:54.061202 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69eb108-7a86-4f88-8b68-71111071cf0b service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:54.078389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 716/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:54.938679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8cec-b0fd-463c-ad31-b9e6afea0199 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:54.939193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8cec-b0fd-463c-ad31-b9e6afea0199 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:54.939193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8cec-b0fd-463c-ad31-b9e6afea0199 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:54.940456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:54.945339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b9f5c-1e18-4326-a983-7a555c9b68ae None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:54.945790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b9f5c-1e18-4326-a983-7a555c9b68ae None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:54.945899 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b9f5c-1e18-4326-a983-7a555c9b68ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:54.965229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:55.020562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-056b9f5c-1e18-4326-a983-7a555c9b68ae None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:55.021787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-056b9f5c-1e18-4326-a983-7a555c9b68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:55.115943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:55.272476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8cec-b0fd-463c-ad31-b9e6afea0199 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:55.273995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6bde8cec-b0fd-463c-ad31-b9e6afea0199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:55.384917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:55.424440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8cec-b0fd-463c-ad31-b9e6afea0199 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:55.536023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff03e65-55b7-40d3-bb94-3b989f939a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:55.536549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03e65-55b7-40d3-bb94-3b989f939a1d service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:55.536824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03e65-55b7-40d3-bb94-3b989f939a1d service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:55.537088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff03e65-55b7-40d3-bb94-3b989f939a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:55.538694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7ff03e65-55b7-40d3-bb94-3b989f939a1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:55.613129 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:55.626613 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff03e65-55b7-40d3-bb94-3b989f939a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:55.628212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff03e65-55b7-40d3-bb94-3b989f939a1d service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:55.646345 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 708/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:56.499135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18d2bb-2ab6-4700-93bf-cc312f9cb98a None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:56.499748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18d2bb-2ab6-4700-93bf-cc312f9cb98a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:56.499748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18d2bb-2ab6-4700-93bf-cc312f9cb98a None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:56.501006 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:56.505884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849ad1e-feee-40da-a114-67a07034b4f1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:56.506324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849ad1e-feee-40da-a114-67a07034b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:56.506453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849ad1e-feee-40da-a114-67a07034b4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:56.580846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2849ad1e-feee-40da-a114-67a07034b4f1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:56.582066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2849ad1e-feee-40da-a114-67a07034b4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:56.675888 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:56.825886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18d2bb-2ab6-4700-93bf-cc312f9cb98a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:56.827373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2e18d2bb-2ab6-4700-93bf-cc312f9cb98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:56.910726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:56.970825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18d2bb-2ab6-4700-93bf-cc312f9cb98a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:57.081426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615deabc-7f64-4d1c-a750-5e3cd4a7bb00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:57.081940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615deabc-7f64-4d1c-a750-5e3cd4a7bb00 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:57.082245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615deabc-7f64-4d1c-a750-5e3cd4a7bb00 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:57.082517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615deabc-7f64-4d1c-a750-5e3cd4a7bb00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:57.084098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-615deabc-7f64-4d1c-a750-5e3cd4a7bb00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:57.130636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:57.170728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615deabc-7f64-4d1c-a750-5e3cd4a7bb00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:57.172298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615deabc-7f64-4d1c-a750-5e3cd4a7bb00 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:57.190217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 719/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:57.989233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93f010-1f59-48d7-930d-396fd47136e7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:57.989637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93f010-1f59-48d7-930d-396fd47136e7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:57.989759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93f010-1f59-48d7-930d-396fd47136e7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:57.991141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:57.996584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4df5b-f594-458f-8414-9899cf42c85a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:57.996983 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4df5b-f594-458f-8414-9899cf42c85a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:57.997146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4df5b-f594-458f-8414-9899cf42c85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:58.070764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-34f4df5b-f594-458f-8414-9899cf42c85a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:58.071972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-34f4df5b-f594-458f-8414-9899cf42c85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:58.168683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:58.318601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93f010-1f59-48d7-930d-396fd47136e7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:58.320139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8c93f010-1f59-48d7-930d-396fd47136e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:58.369937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:58.466082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93f010-1f59-48d7-930d-396fd47136e7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:15:58.580282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4177013-6336-436a-9b6b-4fb2d30341b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:15:58.580886 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4177013-6336-436a-9b6b-4fb2d30341b3 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:58.581162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4177013-6336-436a-9b6b-4fb2d30341b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:58.581430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4177013-6336-436a-9b6b-4fb2d30341b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:58.583048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f4177013-6336-436a-9b6b-4fb2d30341b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:58.590065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:58.671972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4177013-6336-436a-9b6b-4fb2d30341b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:15:58.673552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4177013-6336-436a-9b6b-4fb2d30341b3 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:15:58.691735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 711/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:15:59.496871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3313-0c4d-4c29-a587-f005e34a1939 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:59.497425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3313-0c4d-4c29-a587-f005e34a1939 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:59.497425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d3313-0c4d-4c29-a587-f005e34a1939 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:59.498769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:15:59.503529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a99a33-ea02-4324-928a-db39b973d63b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:15:59.503969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a99a33-ea02-4324-928a-db39b973d63b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:15:59.504097 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a99a33-ea02-4324-928a-db39b973d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:15:59.579667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-94a99a33-ea02-4324-928a-db39b973d63b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:15:59.580872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-94a99a33-ea02-4324-928a-db39b973d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:59.647061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:59.677754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:15:59.829490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3313-0c4d-4c29-a587-f005e34a1939 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:15:59.831044 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7e3d3313-0c4d-4c29-a587-f005e34a1939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:15:59.848135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:15:59.977276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d3313-0c4d-4c29-a587-f005e34a1939 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:00.061240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:00.086956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbc7e7-1924-4eaa-abd4-c57e9ea6c2c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:00.087513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc7e7-1924-4eaa-abd4-c57e9ea6c2c8 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:00.088353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc7e7-1924-4eaa-abd4-c57e9ea6c2c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:00.088626 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbc7e7-1924-4eaa-abd4-c57e9ea6c2c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:00.090257 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dccbc7e7-1924-4eaa-abd4-c57e9ea6c2c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:00.179334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbc7e7-1924-4eaa-abd4-c57e9ea6c2c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:00.180927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbc7e7-1924-4eaa-abd4-c57e9ea6c2c8 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:00.199049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 722/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:00.998923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c7f5a-3b3e-4978-aede-dea6f16af39a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:00.999387 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c7f5a-3b3e-4978-aede-dea6f16af39a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:00.999486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c7f5a-3b3e-4978-aede-dea6f16af39a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:01.000797 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:01.005687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51feb-bea2-427e-806c-16ed428a22b5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:01.006112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51feb-bea2-427e-806c-16ed428a22b5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:01.006264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51feb-bea2-427e-806c-16ed428a22b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:01.079373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5bd51feb-bea2-427e-806c-16ed428a22b5 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:01.080576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5bd51feb-bea2-427e-806c-16ed428a22b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:01.121383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:01.175394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:01.325362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c7f5a-3b3e-4978-aede-dea6f16af39a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:01.326980 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d35c7f5a-3b3e-4978-aede-dea6f16af39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:01.469583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c7f5a-3b3e-4978-aede-dea6f16af39a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:01.524013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:01.586473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a695dc-9624-441c-b31a-b766e7821eee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:01.586998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a695dc-9624-441c-b31a-b766e7821eee service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:01.587274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a695dc-9624-441c-b31a-b766e7821eee service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:01.587538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a695dc-9624-441c-b31a-b766e7821eee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:01.589765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-40a695dc-9624-441c-b31a-b766e7821eee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:01.675762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a695dc-9624-441c-b31a-b766e7821eee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:01.677322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a695dc-9624-441c-b31a-b766e7821eee service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:01.695266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 714/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:02.486933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fbf9b-af41-4793-9524-14c6046db4f8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:02.487512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fbf9b-af41-4793-9524-14c6046db4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:02.487512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fbf9b-af41-4793-9524-14c6046db4f8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:02.488862 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:02.494053 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bbc6b-6153-496a-b4cb-6b05dae473f1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:02.494456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bbc6b-6153-496a-b4cb-6b05dae473f1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:02.494595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bbc6b-6153-496a-b4cb-6b05dae473f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:02.570577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3f6bbc6b-6153-496a-b4cb-6b05dae473f1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:02.571772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3f6bbc6b-6153-496a-b4cb-6b05dae473f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:02.575252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:02.670807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:02.821235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fbf9b-af41-4793-9524-14c6046db4f8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:02.822853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2b1fbf9b-af41-4793-9524-14c6046db4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:02.972777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fbf9b-af41-4793-9524-14c6046db4f8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:02.998562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:03.082143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908bcca-6c16-458e-89d3-7d0d3cb1cf90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:03.082680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908bcca-6c16-458e-89d3-7d0d3cb1cf90 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:03.082956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908bcca-6c16-458e-89d3-7d0d3cb1cf90 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:03.083230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908bcca-6c16-458e-89d3-7d0d3cb1cf90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:03.084822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3908bcca-6c16-458e-89d3-7d0d3cb1cf90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:03.174299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908bcca-6c16-458e-89d3-7d0d3cb1cf90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:03.175890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908bcca-6c16-458e-89d3-7d0d3cb1cf90 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:03.193315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 725/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:05.001195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b360e-59c8-4ce4-828c-b078ee5647eb None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:05.001741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b360e-59c8-4ce4-828c-b078ee5647eb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:05.001741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b360e-59c8-4ce4-828c-b078ee5647eb None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:05.003088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:05.008172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c175-2a84-45e8-a1b1-33573b31ca14 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:05.008576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c175-2a84-45e8-a1b1-33573b31ca14 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:05.008717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c175-2a84-45e8-a1b1-33573b31ca14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:05.048779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:05.072838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e213c175-2a84-45e8-a1b1-33573b31ca14 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:05.074045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e213c175-2a84-45e8-a1b1-33573b31ca14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:05.167984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:05.453060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b360e-59c8-4ce4-828c-b078ee5647eb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:05.454601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f05b360e-59c8-4ce4-828c-b078ee5647eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:05.555409 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b360e-59c8-4ce4-828c-b078ee5647eb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:05.587999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:05.630570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e96d63-b44f-429a-b2b6-a561680c0f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:05.631166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e96d63-b44f-429a-b2b6-a561680c0f7e service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:05.631438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e96d63-b44f-429a-b2b6-a561680c0f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:05.631701 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e96d63-b44f-429a-b2b6-a561680c0f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:05.633289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f6e96d63-b44f-429a-b2b6-a561680c0f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:05.737661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e96d63-b44f-429a-b2b6-a561680c0f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:05.739034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e96d63-b44f-429a-b2b6-a561680c0f7e service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:05.757954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 717/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:07.790321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8bd48-1d4e-44c8-89c6-f1048065c78b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:07.791387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8bd48-1d4e-44c8-89c6-f1048065c78b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:07.791509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8bd48-1d4e-44c8-89c6-f1048065c78b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:07.792848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:07.798090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7a586-1f19-4f59-8a10-4d3f8919e021 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:07.798482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7a586-1f19-4f59-8a10-4d3f8919e021 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:07.798645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7a586-1f19-4f59-8a10-4d3f8919e021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:07.863954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a6e7a586-1f19-4f59-8a10-4d3f8919e021 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:07.865072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a6e7a586-1f19-4f59-8a10-4d3f8919e021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:07.877228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:07.958806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:08.240299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8bd48-1d4e-44c8-89c6-f1048065c78b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:08.241815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-15f8bd48-1d4e-44c8-89c6-f1048065c78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:08.343759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8bd48-1d4e-44c8-89c6-f1048065c78b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:08.356373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:08.420562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44e4a3-c81d-4b92-a98f-eaa535818f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:08.421157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44e4a3-c81d-4b92-a98f-eaa535818f64 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:08.421429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44e4a3-c81d-4b92-a98f-eaa535818f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:08.421691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44e4a3-c81d-4b92-a98f-eaa535818f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:08.423297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7e44e4a3-c81d-4b92-a98f-eaa535818f64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:08.531962 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44e4a3-c81d-4b92-a98f-eaa535818f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:08.533387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44e4a3-c81d-4b92-a98f-eaa535818f64 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:08.552080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 728/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:10.771178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197a3e-44ae-4cdf-8bc7-969b82d53316 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:10.771719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197a3e-44ae-4cdf-8bc7-969b82d53316 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:10.771719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92197a3e-44ae-4cdf-8bc7-969b82d53316 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:10.773095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:10.778443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bda1d-07c0-4bd7-b68d-4450fceb33af None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:10.778861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bda1d-07c0-4bd7-b68d-4450fceb33af None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:10.778989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bda1d-07c0-4bd7-b68d-4450fceb33af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:10.826438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:10.844644 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-513bda1d-07c0-4bd7-b68d-4450fceb33af None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:10.845837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-513bda1d-07c0-4bd7-b68d-4450fceb33af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:10.941504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:11.223018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92197a3e-44ae-4cdf-8bc7-969b82d53316 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:11.224559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-92197a3e-44ae-4cdf-8bc7-969b82d53316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:11.327111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92197a3e-44ae-4cdf-8bc7-969b82d53316 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:11.366325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:11.399513 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354bf8d-68de-4295-8a85-273a466a4def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:11.400662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354bf8d-68de-4295-8a85-273a466a4def service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:11.400936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354bf8d-68de-4295-8a85-273a466a4def service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:11.401202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354bf8d-68de-4295-8a85-273a466a4def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:11.402819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9354bf8d-68de-4295-8a85-273a466a4def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:11.510202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354bf8d-68de-4295-8a85-273a466a4def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:11.511645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354bf8d-68de-4295-8a85-273a466a4def service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:11.529896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 720/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:13.553953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eeb2e-d1a4-477e-a67c-fd9d5fe724ee None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:13.554530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eeb2e-d1a4-477e-a67c-fd9d5fe724ee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:13.554530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6eeb2e-d1a4-477e-a67c-fd9d5fe724ee None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:13.555894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:13.561306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b1d3a-0fc2-4311-ab46-dfd010ea1731 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:13.561683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b1d3a-0fc2-4311-ab46-dfd010ea1731 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:13.561875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b1d3a-0fc2-4311-ab46-dfd010ea1731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:13.626542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5a2b1d3a-0fc2-4311-ab46-dfd010ea1731 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:13.627778 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a2b1d3a-0fc2-4311-ab46-dfd010ea1731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:13.649179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:13.724182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:14.007380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eeb2e-d1a4-477e-a67c-fd9d5fe724ee None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:14.008983 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3b6eeb2e-d1a4-477e-a67c-fd9d5fe724ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:14.110687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6eeb2e-d1a4-477e-a67c-fd9d5fe724ee None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:14.130297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:14.186183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0473df-e33f-47dd-a34e-1689f53b5c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:14.186792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0473df-e33f-47dd-a34e-1689f53b5c39 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:14.187068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0473df-e33f-47dd-a34e-1689f53b5c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:14.187331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0473df-e33f-47dd-a34e-1689f53b5c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:14.189005 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6c0473df-e33f-47dd-a34e-1689f53b5c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:14.297103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0473df-e33f-47dd-a34e-1689f53b5c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:14.298565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0473df-e33f-47dd-a34e-1689f53b5c39 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:14.316331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 731/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:16.271735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9db0aa-6442-4e06-8a98-a0f1a2fb09c7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:16.272256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9db0aa-6442-4e06-8a98-a0f1a2fb09c7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:16.272376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9db0aa-6442-4e06-8a98-a0f1a2fb09c7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:16.273610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:16.279028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713d9c-6bee-4f60-9c3a-462504cb2dae None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:16.279452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713d9c-6bee-4f60-9c3a-462504cb2dae None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:16.279572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713d9c-6bee-4f60-9c3a-462504cb2dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:16.342063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:16.345084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c6713d9c-6bee-4f60-9c3a-462504cb2dae None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:16.346903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c6713d9c-6bee-4f60-9c3a-462504cb2dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:16.441570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:16.724390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9db0aa-6442-4e06-8a98-a0f1a2fb09c7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:16.725932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3f9db0aa-6442-4e06-8a98-a0f1a2fb09c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:16.829250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9db0aa-6442-4e06-8a98-a0f1a2fb09c7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:16.879106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:16.905233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607419ae-0a35-4d54-a7a1-8b5c91a81ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:16.905943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607419ae-0a35-4d54-a7a1-8b5c91a81ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:16.906248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607419ae-0a35-4d54-a7a1-8b5c91a81ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:16.906515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607419ae-0a35-4d54-a7a1-8b5c91a81ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:16.908233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-607419ae-0a35-4d54-a7a1-8b5c91a81ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:17.014802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607419ae-0a35-4d54-a7a1-8b5c91a81ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:17.016229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607419ae-0a35-4d54-a7a1-8b5c91a81ae3 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:17.034333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 723/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:19.003275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b7d67-38e7-4912-901d-9863bb17b3fd None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:19.003841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b7d67-38e7-4912-901d-9863bb17b3fd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:19.003841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b7d67-38e7-4912-901d-9863bb17b3fd None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:19.005216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:19.010395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdef950-3ed3-476b-9062-e489ea6c5181 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:19.010833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdef950-3ed3-476b-9062-e489ea6c5181 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:19.010952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdef950-3ed3-476b-9062-e489ea6c5181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:19.074927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7cdef950-3ed3-476b-9062-e489ea6c5181 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:19.076123 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7cdef950-3ed3-476b-9062-e489ea6c5181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:19.105595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:19.172267 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:19.462247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b7d67-38e7-4912-901d-9863bb17b3fd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:19.463832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2c0b7d67-38e7-4912-901d-9863bb17b3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:19.568751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b7d67-38e7-4912-901d-9863bb17b3fd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:19.596181 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:19.642020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3193d-2b92-4765-aea1-32f2cb46d695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:19.642683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3193d-2b92-4765-aea1-32f2cb46d695 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:19.642968 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3193d-2b92-4765-aea1-32f2cb46d695 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:19.643243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3193d-2b92-4765-aea1-32f2cb46d695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:19.644868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8db3193d-2b92-4765-aea1-32f2cb46d695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:19.753699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3193d-2b92-4765-aea1-32f2cb46d695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:19.755235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3193d-2b92-4765-aea1-32f2cb46d695 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:19.773283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 734/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:21.773538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5c4fc-075c-49fa-ba1c-55ab77ec76e8 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:21.774154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5c4fc-075c-49fa-ba1c-55ab77ec76e8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:21.774154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5c4fc-075c-49fa-ba1c-55ab77ec76e8 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:21.775454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:21.780538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a9b50-fdda-496f-bdd6-75da5bafd441 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:21.780947 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a9b50-fdda-496f-bdd6-75da5bafd441 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:21.781082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a9b50-fdda-496f-bdd6-75da5bafd441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:21.848366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-707a9b50-fdda-496f-bdd6-75da5bafd441 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:21.849485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-707a9b50-fdda-496f-bdd6-75da5bafd441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:21.858125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:21.944736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:22.230213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5c4fc-075c-49fa-ba1c-55ab77ec76e8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:22.231765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d2f5c4fc-075c-49fa-ba1c-55ab77ec76e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:22.333573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5c4fc-075c-49fa-ba1c-55ab77ec76e8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:22.389167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:22.407654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd0f05-9438-4333-af6a-a406e9654cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:22.408257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd0f05-9438-4333-af6a-a406e9654cae service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:22.408537 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd0f05-9438-4333-af6a-a406e9654cae service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:22.408808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd0f05-9438-4333-af6a-a406e9654cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:22.410443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-75fd0f05-9438-4333-af6a-a406e9654cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:22.517802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd0f05-9438-4333-af6a-a406e9654cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:22.519310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd0f05-9438-4333-af6a-a406e9654cae service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:22.538323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 726/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:24.513154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684635ec-6368-4617-acf5-a336f33d98a8 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:24.513721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684635ec-6368-4617-acf5-a336f33d98a8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:24.513721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684635ec-6368-4617-acf5-a336f33d98a8 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:24.515121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:24.520388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844c717-a5f5-4ca1-93ba-106816143b0f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:24.520869 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844c717-a5f5-4ca1-93ba-106816143b0f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:24.520975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844c717-a5f5-4ca1-93ba-106816143b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:24.586818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2844c717-a5f5-4ca1-93ba-106816143b0f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:24.588029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2844c717-a5f5-4ca1-93ba-106816143b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:24.627345 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:24.685664 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:24.964383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684635ec-6368-4617-acf5-a336f33d98a8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:24.965921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-684635ec-6368-4617-acf5-a336f33d98a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:25.071076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684635ec-6368-4617-acf5-a336f33d98a8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:25.110342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:25.145230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa810c-a04a-493e-8b6d-9290bece0feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:25.145835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa810c-a04a-493e-8b6d-9290bece0feb service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:25.146144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa810c-a04a-493e-8b6d-9290bece0feb service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:25.146421 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa810c-a04a-493e-8b6d-9290bece0feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:25.148023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c0aa810c-a04a-493e-8b6d-9290bece0feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:25.255176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa810c-a04a-493e-8b6d-9290bece0feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:25.256645 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa810c-a04a-493e-8b6d-9290bece0feb service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:25.276646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 737/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:27.217283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0d495-4fb3-4f30-9c7a-9ae061724c06 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:27.217849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0d495-4fb3-4f30-9c7a-9ae061724c06 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:27.217849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0d495-4fb3-4f30-9c7a-9ae061724c06 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:27.219283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:27.224482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658a45-37be-4107-9fee-8f247d9cbea1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:27.224917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658a45-37be-4107-9fee-8f247d9cbea1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:27.225029 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed658a45-37be-4107-9fee-8f247d9cbea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:27.291090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ed658a45-37be-4107-9fee-8f247d9cbea1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:27.292904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ed658a45-37be-4107-9fee-8f247d9cbea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:27.310680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:27.391818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:27.681722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0d495-4fb3-4f30-9c7a-9ae061724c06 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:27.683310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5eb0d495-4fb3-4f30-9c7a-9ae061724c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:27.786566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0d495-4fb3-4f30-9c7a-9ae061724c06 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:27.853063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:27.860745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe39d5-5757-404c-9910-d40bf4e21417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:27.861349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe39d5-5757-404c-9910-d40bf4e21417 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:27.861629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe39d5-5757-404c-9910-d40bf4e21417 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:27.861900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe39d5-5757-404c-9910-d40bf4e21417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:27.863521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fdbe39d5-5757-404c-9910-d40bf4e21417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:27.971258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe39d5-5757-404c-9910-d40bf4e21417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:27.972688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe39d5-5757-404c-9910-d40bf4e21417 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:27.991129 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 729/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:29.913243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bda02-b16f-45f1-a3d7-00ea98d30bc1 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:29.913806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bda02-b16f-45f1-a3d7-00ea98d30bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:29.913806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bda02-b16f-45f1-a3d7-00ea98d30bc1 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:29.915075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:29.920239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f71f3d-8c54-4679-90b6-01b43975f25f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:29.920641 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f71f3d-8c54-4679-90b6-01b43975f25f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:29.920934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f71f3d-8c54-4679-90b6-01b43975f25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:29.985812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b0f71f3d-8c54-4679-90b6-01b43975f25f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:29.987052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b0f71f3d-8c54-4679-90b6-01b43975f25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:30.037056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:30.084386 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:30.372003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bda02-b16f-45f1-a3d7-00ea98d30bc1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:30.373542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e46bda02-b16f-45f1-a3d7-00ea98d30bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:30.476217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bda02-b16f-45f1-a3d7-00ea98d30bc1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:30.523850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:30.550773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff7637-d6f7-49fd-acc1-b9a59f6d4525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:30.551382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff7637-d6f7-49fd-acc1-b9a59f6d4525 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:30.551662 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff7637-d6f7-49fd-acc1-b9a59f6d4525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:30.551934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff7637-d6f7-49fd-acc1-b9a59f6d4525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:30.553549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-75ff7637-d6f7-49fd-acc1-b9a59f6d4525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:30.660569 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff7637-d6f7-49fd-acc1-b9a59f6d4525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:30.661993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff7637-d6f7-49fd-acc1-b9a59f6d4525 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:30.681287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 740/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:40.082599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=22 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:40.678697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=66 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:50.025359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57aeaa-8fa4-4a2b-8e3f-3378cad0e6b1 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:50.025806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57aeaa-8fa4-4a2b-8e3f-3378cad0e6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:50.025929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57aeaa-8fa4-4a2b-8e3f-3378cad0e6b1 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:50.027377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 731/1471] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:16:50.032692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c1948-8e17-43c7-b3e0-33e382405c19 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:50.033102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c1948-8e17-43c7-b3e0-33e382405c19 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:50.033309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c1948-8e17-43c7-b3e0-33e382405c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:50.099066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d59c1948-8e17-43c7-b3e0-33e382405c19 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:50.100302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d59c1948-8e17-43c7-b3e0-33e382405c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:50.197843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 741/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:50.494982 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d7336-4a3f-47b8-91a3-84b5dc312276 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:50.495267 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d7336-4a3f-47b8-91a3-84b5dc312276 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:50.495539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d7336-4a3f-47b8-91a3-84b5dc312276 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:50.496840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 732/1473] 10.222.0.20 () {54 vars in 967 bytes} [Fri Aug 19 15:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:50.501583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace57f2-78ab-4c3d-a5ee-a5e48c9e9f34 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:50.501873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace57f2-78ab-4c3d-a5ee-a5e48c9e9f34 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:50.502181 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace57f2-78ab-4c3d-a5ee-a5e48c9e9f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:50.577873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dace57f2-78ab-4c3d-a5ee-a5e48c9e9f34 None None] MFA Rules not processed for user `c23bb3a6586247e0a11ece33569d6d69`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:50.579115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dace57f2-78ab-4c3d-a5ee-a5e48c9e9f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:50.598907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:50.654555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 742/1474] 10.222.0.20 () {58 vars in 1064 bytes} [Fri Aug 19 15:16:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:50.662223 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d7336-4a3f-47b8-91a3-84b5dc312276 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:50.663736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-855d7336-4a3f-47b8-91a3-84b5dc312276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:50.765290 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d7336-4a3f-47b8-91a3-84b5dc312276 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:50.837524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f939a73-0ade-494f-8c76-5cfd3f52d0bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23bb3a6586247e0a11ece33569d6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:50.838158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939a73-0ade-494f-8c76-5cfd3f52d0bf service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:50.838442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939a73-0ade-494f-8c76-5cfd3f52d0bf service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:50.838715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f939a73-0ade-494f-8c76-5cfd3f52d0bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:50.840320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9f939a73-0ade-494f-8c76-5cfd3f52d0bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:50.893676 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:50.948220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f939a73-0ade-494f-8c76-5cfd3f52d0bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:50.949652 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f939a73-0ade-494f-8c76-5cfd3f52d0bf service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:50.969257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 733/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:52.953407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9491b-115a-4b76-9ae6-37630d7f890b None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:52.953981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9491b-115a-4b76-9ae6-37630d7f890b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:52.953981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9491b-115a-4b76-9ae6-37630d7f890b None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:52.955259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 743/1476] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:52.960347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35b58b-cdd0-4f32-b824-59abd1947913 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:52.960794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35b58b-cdd0-4f32-b824-59abd1947913 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:52.960910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35b58b-cdd0-4f32-b824-59abd1947913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:53.026400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bd35b58b-cdd0-4f32-b824-59abd1947913 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:53.027596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bd35b58b-cdd0-4f32-b824-59abd1947913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:53.119689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 734/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:53.389643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9491b-115a-4b76-9ae6-37630d7f890b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:53.391204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ccb9491b-115a-4b76-9ae6-37630d7f890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:53.513883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9491b-115a-4b76-9ae6-37630d7f890b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:53.561773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:53.608319 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4792ad-b505-4dc5-be2f-49281745ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:53.608924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4792ad-b505-4dc5-be2f-49281745ea80 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:53.609205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4792ad-b505-4dc5-be2f-49281745ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:53.609477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4792ad-b505-4dc5-be2f-49281745ea80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:53.610152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4792ad-b505-4dc5-be2f-49281745ea80 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:53.611868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-5c4792ad-b505-4dc5-be2f-49281745ea80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:16:53.611868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 19 15:16:53.611868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: Aug 19 15:16:53.613012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4792ad-b505-4dc5-be2f-49281745ea80 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:53.631342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 744/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Aug 19 15:16:53 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:16:55.541200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77a7f-566d-4f05-92c9-08804dc5bb14 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:55.541755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77a7f-566d-4f05-92c9-08804dc5bb14 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:55.541755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77a7f-566d-4f05-92c9-08804dc5bb14 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:55.543136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 735/1479] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:55.548414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc10f5-f1a6-4932-a9db-bae00bce708a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:55.548850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc10f5-f1a6-4932-a9db-bae00bce708a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:55.548996 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc10f5-f1a6-4932-a9db-bae00bce708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:55.613997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c6cc10f5-f1a6-4932-a9db-bae00bce708a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:55.615225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c6cc10f5-f1a6-4932-a9db-bae00bce708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:55.708693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 745/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:56.016036 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de77a7f-566d-4f05-92c9-08804dc5bb14 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:56.017630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1de77a7f-566d-4f05-92c9-08804dc5bb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:56.027533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:56.163005 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de77a7f-566d-4f05-92c9-08804dc5bb14 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:56.242240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:56.275015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1973f-f1b8-4d7c-b7bb-14b786e558f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:56.275617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1973f-f1b8-4d7c-b7bb-14b786e558f1 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:56.275918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1973f-f1b8-4d7c-b7bb-14b786e558f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:56.276713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1973f-f1b8-4d7c-b7bb-14b786e558f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:56.278329 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1eb1973f-f1b8-4d7c-b7bb-14b786e558f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:56.365399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1973f-f1b8-4d7c-b7bb-14b786e558f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:56.366994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1973f-f1b8-4d7c-b7bb-14b786e558f1 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:56.385080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 736/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:16:58.505653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a2a2-5c19-4ba2-a990-5f4ea715db32 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:58.506231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a2a2-5c19-4ba2-a990-5f4ea715db32 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:58.506231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a2a2-5c19-4ba2-a990-5f4ea715db32 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:58.507564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 746/1482] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:16:58.513356 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fa282-3aa7-4f55-a2a1-9037d0c173e2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:58.513800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fa282-3aa7-4f55-a2a1-9037d0c173e2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:58.514053 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fa282-3aa7-4f55-a2a1-9037d0c173e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:58.583759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d49fa282-3aa7-4f55-a2a1-9037d0c173e2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:16:58.584657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d49fa282-3aa7-4f55-a2a1-9037d0c173e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:58.631410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:58.682526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 737/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:16:58.974370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026a2a2-5c19-4ba2-a990-5f4ea715db32 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:16:58.976049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3026a2a2-5c19-4ba2-a990-5f4ea715db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:59.000396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:59.079176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026a2a2-5c19-4ba2-a990-5f4ea715db32 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:16:59.155801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16647a-4e66-40ab-8253-d3f8cca80a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:16:59.156417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16647a-4e66-40ab-8253-d3f8cca80a76 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:16:59.156696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16647a-4e66-40ab-8253-d3f8cca80a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:16:59.157001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16647a-4e66-40ab-8253-d3f8cca80a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:16:59.158636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ea16647a-4e66-40ab-8253-d3f8cca80a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:16:59.231738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:16:59.266171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16647a-4e66-40ab-8253-d3f8cca80a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:16:59.267604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16647a-4e66-40ab-8253-d3f8cca80a76 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:16:59.287658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 747/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:17:01.265623 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b6891-98af-4eb1-8df2-a2d919fa909b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:17:01.266201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b6891-98af-4eb1-8df2-a2d919fa909b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:17:01.266201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b6891-98af-4eb1-8df2-a2d919fa909b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:17:01.267529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 738/1485] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:17:01.272544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb88eec-9967-45b2-a6d4-555f53b41ca9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:17:01.272931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb88eec-9967-45b2-a6d4-555f53b41ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:17:01.273090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb88eec-9967-45b2-a6d4-555f53b41ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:17:01.337212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bfb88eec-9967-45b2-a6d4-555f53b41ca9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:17:01.338444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bfb88eec-9967-45b2-a6d4-555f53b41ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:17:01.433271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 748/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:17:01.720854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b6891-98af-4eb1-8df2-a2d919fa909b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:17:01.722501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f40b6891-98af-4eb1-8df2-a2d919fa909b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:17:01.833909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b6891-98af-4eb1-8df2-a2d919fa909b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:17:01.905080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:17:01.906892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d6938-e17e-453e-a09b-1ecd61880fe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:17:01.907503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6938-e17e-453e-a09b-1ecd61880fe7 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:17:01.907965 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6938-e17e-453e-a09b-1ecd61880fe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:17:01.908441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6938-e17e-453e-a09b-1ecd61880fe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:17:01.910262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1c1d6938-e17e-453e-a09b-1ecd61880fe7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:17:02.027068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d6938-e17e-453e-a09b-1ecd61880fe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:17:02.028515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d6938-e17e-453e-a09b-1ecd61880fe7 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:17:02.046861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 739/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:17:04.171700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4453-7293-4310-89f8-c8be04583a99 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:17:04.172221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4453-7293-4310-89f8-c8be04583a99 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:17:04.172221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4453-7293-4310-89f8-c8be04583a99 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:17:04.173583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 749/1488] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:17:04.178968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68914-5aea-4df1-ab59-d73ee2b3d48e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:17:04.179395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68914-5aea-4df1-ab59-d73ee2b3d48e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:17:04.179519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68914-5aea-4df1-ab59-d73ee2b3d48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:17:04.247329 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d1d68914-5aea-4df1-ab59-d73ee2b3d48e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:17:04.248559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d1d68914-5aea-4df1-ab59-d73ee2b3d48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:17:04.303757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:17:04.348532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 740/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:17:04.639289 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe4453-7293-4310-89f8-c8be04583a99 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:17:04.640822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-51fe4453-7293-4310-89f8-c8be04583a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:17:04.676453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:17:04.743128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe4453-7293-4310-89f8-c8be04583a99 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:17:04.818697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd08c0c-6d81-444b-8c94-3c89e9ad7286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:17:04.819232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd08c0c-6d81-444b-8c94-3c89e9ad7286 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:17:04.819534 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd08c0c-6d81-444b-8c94-3c89e9ad7286 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:17:04.819807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd08c0c-6d81-444b-8c94-3c89e9ad7286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:17:04.821410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fcd08c0c-6d81-444b-8c94-3c89e9ad7286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:17:04.900238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:17:04.930383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd08c0c-6d81-444b-8c94-3c89e9ad7286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:17:04.931863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd08c0c-6d81-444b-8c94-3c89e9ad7286 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:17:04.951243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 750/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:17:07.125325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04fe4c-7ca8-4846-9da7-3f6eb2617a1b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:17:07.125869 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04fe4c-7ca8-4846-9da7-3f6eb2617a1b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:17:07.125869 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04fe4c-7ca8-4846-9da7-3f6eb2617a1b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:17:07.127270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 741/1491] 10.222.0.20 () {54 vars in 927 bytes} [Fri Aug 19 15:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:17:07.132775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abff81-49df-4457-9b95-c1cc6262f847 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:17:07.133235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abff81-49df-4457-9b95-c1cc6262f847 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:17:07.133346 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abff81-49df-4457-9b95-c1cc6262f847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:17:07.199740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d5abff81-49df-4457-9b95-c1cc6262f847 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:17:07.200986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d5abff81-49df-4457-9b95-c1cc6262f847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:17:07.298474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 751/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Aug 19 15:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:17:07.584796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04fe4c-7ca8-4846-9da7-3f6eb2617a1b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:17:07.586385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0a04fe4c-7ca8-4846-9da7-3f6eb2617a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:17:07.688615 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04fe4c-7ca8-4846-9da7-3f6eb2617a1b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:17:07.765734 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5edad5-9ee3-4b3f-8fc6-17dc93ab6d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:17:07.766741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5edad5-9ee3-4b3f-8fc6-17dc93ab6d40 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:17:07.767151 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5edad5-9ee3-4b3f-8fc6-17dc93ab6d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:17:07.767686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5edad5-9ee3-4b3f-8fc6-17dc93ab6d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:17:07.770563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ff5edad5-9ee3-4b3f-8fc6-17dc93ab6d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:17:07.786073 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:17:07.899932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5edad5-9ee3-4b3f-8fc6-17dc93ab6d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:17:07.901595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5edad5-9ee3-4b3f-8fc6-17dc93ab6d40 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:17:07.921973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 742/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:17:17.296572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=82 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:17:17.919605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=50 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:19.123263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe07b8-aa40-4db9-9e1d-a9b88e8bb834 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:19.123875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe07b8-aa40-4db9-9e1d-a9b88e8bb834 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:19.123875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe07b8-aa40-4db9-9e1d-a9b88e8bb834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:19.200625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3dfe07b8-aa40-4db9-9e1d-a9b88e8bb834 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:18:19.201850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3dfe07b8-aa40-4db9-9e1d-a9b88e8bb834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:19.299145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 752/1494] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:18:19.307440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b39f-bb48-478e-9e2e-ee325a041fcb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:19.307989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b39f-bb48-478e-9e2e-ee325a041fcb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:19.307989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b39f-bb48-478e-9e2e-ee325a041fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:19.388661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3fd0b39f-bb48-478e-9e2e-ee325a041fcb None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:18:19.389840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3fd0b39f-bb48-478e-9e2e-ee325a041fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:19.498292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 743/1495] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:18:19.502984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe07b8-aa40-4db9-9e1d-a9b88e8bb834 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:18:19.504197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3dfe07b8-aa40-4db9-9e1d-a9b88e8bb834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:19.516022 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe07b8-aa40-4db9-9e1d-a9b88e8bb834 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:18:19.579049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:19.613851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843c9a4-38f5-4fa6-9ddf-9ee3bd394d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:18:19.614488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c9a4-38f5-4fa6-9ddf-9ee3bd394d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:19.614767 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c9a4-38f5-4fa6-9ddf-9ee3bd394d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:19.615036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c9a4-38f5-4fa6-9ddf-9ee3bd394d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:19.615683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843c9a4-38f5-4fa6-9ddf-9ee3bd394d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:18:19.615982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843c9a4-38f5-4fa6-9ddf-9ee3bd394d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:18:19.616998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-0843c9a4-38f5-4fa6-9ddf-9ee3bd394d7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:18:19.616998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 19 15:18:19.616998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: Aug 19 15:18:19.617916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843c9a4-38f5-4fa6-9ddf-9ee3bd394d7b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:18:19.631218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 753/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:18:19.640162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b39f-bb48-478e-9e2e-ee325a041fcb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:18:19.650005 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b39f-bb48-478e-9e2e-ee325a041fcb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:18:19.711411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:19.747645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895a02-1d17-4475-8fa4-2633617c5dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:18:19.748243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895a02-1d17-4475-8fa4-2633617c5dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:19.748518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895a02-1d17-4475-8fa4-2633617c5dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:19.748789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895a02-1d17-4475-8fa4-2633617c5dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:19.749418 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac895a02-1d17-4475-8fa4-2633617c5dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:18:19.751192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-ac895a02-1d17-4475-8fa4-2633617c5dd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:18:19.751192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: warnings.warn(msg) Aug 19 15:18:19.751192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: Aug 19 15:18:19.752385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac895a02-1d17-4475-8fa4-2633617c5dd4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:18:19.808176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 744/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:18:19 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:18:19.812424 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843c9a4-38f5-4fa6-9ddf-9ee3bd394d7b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:18:19.813965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0843c9a4-38f5-4fa6-9ddf-9ee3bd394d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:19.848601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843c9a4-38f5-4fa6-9ddf-9ee3bd394d7b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:18:19.947922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e32f8-9b0d-4f81-a20f-a7332b4bde1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:18:19.948457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e32f8-9b0d-4f81-a20f-a7332b4bde1f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:19.948742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e32f8-9b0d-4f81-a20f-a7332b4bde1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:19.949013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e32f8-9b0d-4f81-a20f-a7332b4bde1f admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:19.949652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e32f8-9b0d-4f81-a20f-a7332b4bde1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:18:19.950713 dv-cinder-835384-20-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-083e32f8-9b0d-4f81-a20f-a7332b4bde1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:18:19.950713 dv-cinder-835384-20-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 19 15:18:19.950713 dv-cinder-835384-20-smb devstack@keystone.service[81449]: Aug 19 15:18:19.951915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e32f8-9b0d-4f81-a20f-a7332b4bde1f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:18:19.996678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 754/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:18:19 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:18:20.000995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895a02-1d17-4475-8fa4-2633617c5dd4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:18:20.002540 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ac895a02-1d17-4475-8fa4-2633617c5dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:20.067754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895a02-1d17-4475-8fa4-2633617c5dd4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:18:20.156301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:20.168611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0b11a-12c3-4e03-8585-5d82137efb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:18:20.169221 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0b11a-12c3-4e03-8585-5d82137efb20 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:20.169500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0b11a-12c3-4e03-8585-5d82137efb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:20.169771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0b11a-12c3-4e03-8585-5d82137efb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:20.170452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0b11a-12c3-4e03-8585-5d82137efb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:18:20.171470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-28c0b11a-12c3-4e03-8585-5d82137efb20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:18:20.171470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: warnings.warn(msg) Aug 19 15:18:20.171470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: Aug 19 15:18:20.172360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0b11a-12c3-4e03-8585-5d82137efb20 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:18:20.194616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 745/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:18:20.195833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e32f8-9b0d-4f81-a20f-a7332b4bde1f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:18:20.197588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-083e32f8-9b0d-4f81-a20f-a7332b4bde1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:20.209121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e32f8-9b0d-4f81-a20f-a7332b4bde1f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:18:20.235228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:20.311653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4b1a1-f66d-4821-80e1-f129bedd709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:18:20.312261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4b1a1-f66d-4821-80e1-f129bedd709f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:20.312539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4b1a1-f66d-4821-80e1-f129bedd709f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:20.312805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4b1a1-f66d-4821-80e1-f129bedd709f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:20.313441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4b1a1-f66d-4821-80e1-f129bedd709f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:18:20.314483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-6ca4b1a1-f66d-4821-80e1-f129bedd709f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:18:20.314483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 19 15:18:20.314483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: Aug 19 15:18:20.315360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4b1a1-f66d-4821-80e1-f129bedd709f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:18:20.328413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 755/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:18:20.333455 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0b11a-12c3-4e03-8585-5d82137efb20 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:18:20.334753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-28c0b11a-12c3-4e03-8585-5d82137efb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:20.369652 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0b11a-12c3-4e03-8585-5d82137efb20 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:18:20.472042 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f4b85-545c-4c79-904d-1bd102622509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:18:20.472612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f4b85-545c-4c79-904d-1bd102622509 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:20.472886 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f4b85-545c-4c79-904d-1bd102622509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:20.473153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f4b85-545c-4c79-904d-1bd102622509 admin admin] PATH_INFO: `/v3/projects/f4d2130b9eca4276afb88764e9f3cb02/users/a755b2284df94ea3adcb17791bdbb643/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:20.496299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f4b85-545c-4c79-904d-1bd102622509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d2130b9eca4276afb88764e9f3cb02, user_id=a755b2284df94ea3adcb17791bdbb643, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:18:20.497333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-040f4b85-545c-4c79-904d-1bd102622509 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:18:20.497333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: warnings.warn(msg) Aug 19 15:18:20.497333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: Aug 19 15:18:20.499593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f4b85-545c-4c79-904d-1bd102622509 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:18:20.531481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 746/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:18:20 2022] PUT /identity/v3/projects/f4d2130b9eca4276afb88764e9f3cb02/users/a755b2284df94ea3adcb17791bdbb643/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:18:20.543758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a32ff6-8969-4821-a6c2-55fc6648d75b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:20.544047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a32ff6-8969-4821-a6c2-55fc6648d75b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:20.544321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a32ff6-8969-4821-a6c2-55fc6648d75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:20.604470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-97a32ff6-8969-4821-a6c2-55fc6648d75b None None] MFA Rules not processed for user `a755b2284df94ea3adcb17791bdbb643`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:18:20.605713 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-97a32ff6-8969-4821-a6c2-55fc6648d75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:20.685575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 756/1502] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:18:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:18:20.699486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0d32-887a-4b94-878f-9a46aed0a540 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:20.699769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0d32-887a-4b94-878f-9a46aed0a540 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:20.700046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0d32-887a-4b94-878f-9a46aed0a540 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:20.701388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 747/1503] 10.222.0.20 () {54 vars in 964 bytes} [Fri Aug 19 15:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:18:20.706684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60fa5b-523a-45bb-aba9-960f34988e43 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:20.707020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60fa5b-523a-45bb-aba9-960f34988e43 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:20.707383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60fa5b-523a-45bb-aba9-960f34988e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:20.739930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:20.792324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9e60fa5b-523a-45bb-aba9-960f34988e43 None None] MFA Rules not processed for user `895028dd70a0415595a0ff8ebedb1f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:18:20.793562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9e60fa5b-523a-45bb-aba9-960f34988e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:20.870530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 757/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Aug 19 15:18:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:18:20.878656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db0d32-887a-4b94-878f-9a46aed0a540 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:18:20.880202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a0db0d32-887a-4b94-878f-9a46aed0a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:20.931721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:20.988641 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db0d32-887a-4b94-878f-9a46aed0a540 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:18:21.064162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a5a31-06f9-42e7-af0d-cf9d58f15a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:18:21.064774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a5a31-06f9-42e7-af0d-cf9d58f15a47 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:21.065057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a5a31-06f9-42e7-af0d-cf9d58f15a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:21.065330 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a5a31-06f9-42e7-af0d-cf9d58f15a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:21.066993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e04a5a31-06f9-42e7-af0d-cf9d58f15a47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:21.184635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a5a31-06f9-42e7-af0d-cf9d58f15a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:18:21.186103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a5a31-06f9-42e7-af0d-cf9d58f15a47 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:18:21.189774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:21.204874 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 748/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:18:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:18:21.251312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec0403-e0f6-434b-9341-556b33cb3883 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:21.251784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec0403-e0f6-434b-9341-556b33cb3883 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:21.251903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec0403-e0f6-434b-9341-556b33cb3883 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:21.253154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 758/1506] 10.222.0.20 () {52 vars in 830 bytes} [Fri Aug 19 15:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:18:21.256933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a5a31-06f9-42e7-af0d-cf9d58f15a47 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:18:21.258183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e04a5a31-06f9-42e7-af0d-cf9d58f15a47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:21.359965 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a5a31-06f9-42e7-af0d-cf9d58f15a47 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:18:21.466692 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:18:21.467347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:21.467620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:21.467889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] PATH_INFO: `/v3/users/a755b2284df94ea3adcb17791bdbb643` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:21.481858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a755b2284df94ea3adcb17791bdbb643)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:18:21.482929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:18:21.482929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: warnings.warn(msg) Aug 19 15:18:21.482929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: Aug 19 15:18:21.484143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:18:21.494628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:21.557769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a755b2284df94ea3adcb17791bdbb643'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:18:21.558358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a755b2284df94ea3adcb17791bdbb643'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:18:21.558796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a755b2284df94ea3adcb17791bdbb643'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:18:21.568803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a755b2284df94ea3adcb17791bdbb643'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:18:21.583103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a755b2284df94ea3adcb17791bdbb643'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:18:21.615828 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 749/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:18:21 2022] DELETE /identity/v3/users/a755b2284df94ea3adcb17791bdbb643 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:18:21.620791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58e899-1ea0-4b8f-8f7f-879275d65fb3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:21.621069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58e899-1ea0-4b8f-8f7f-879275d65fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:21.621342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58e899-1ea0-4b8f-8f7f-879275d65fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:21.682659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ef58e899-1ea0-4b8f-8f7f-879275d65fb3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:18:21.683885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef58e899-1ea0-4b8f-8f7f-879275d65fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:21.759888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:21.778323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 759/1508] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:18:21.788834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:18:21.790636 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:21.896479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265cdfa-3e47-4eef-80ad-cfe0b649d215 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:18:21.958756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:21.980773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95497866-4ddb-441c-a94b-4fb5ba1d0385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:18:21.981382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95497866-4ddb-441c-a94b-4fb5ba1d0385 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:21.981666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95497866-4ddb-441c-a94b-4fb5ba1d0385 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:21.981942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95497866-4ddb-441c-a94b-4fb5ba1d0385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:21.983605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-95497866-4ddb-441c-a94b-4fb5ba1d0385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:22.096382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95497866-4ddb-441c-a94b-4fb5ba1d0385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:18:22.097823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95497866-4ddb-441c-a94b-4fb5ba1d0385 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:18:22.120741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 750/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:18:22.479418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58e899-1ea0-4b8f-8f7f-879275d65fb3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:18:22.480706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef58e899-1ea0-4b8f-8f7f-879275d65fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:18:22.492366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58e899-1ea0-4b8f-8f7f-879275d65fb3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:18:22.613845 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:18:22.614663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:18:22.614939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:18:22.615207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] PATH_INFO: `/v3/projects/f4d2130b9eca4276afb88764e9f3cb02` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:18:22.625301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d2130b9eca4276afb88764e9f3cb02)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:18:22.626364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:18:22.626364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 19 15:18:22.626364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: Aug 19 15:18:22.627549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:18:22.692367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d2130b9eca4276afb88764e9f3cb02', 'request_id': 'req-5990eb43-8c2f-4265-a272-651e695c72d9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:18:22.698984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d2130b9eca4276afb88764e9f3cb02', 'request_id': 'req-5990eb43-8c2f-4265-a272-651e695c72d9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:18:22.708155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d2130b9eca4276afb88764e9f3cb02', 'request_id': 'req-5990eb43-8c2f-4265-a272-651e695c72d9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:18:22.739659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] The token cache is being invalidate because project f4d2130b9eca4276afb88764e9f3cb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:18:22.739967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:18:22.740375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5990eb43-8c2f-4265-a272-651e695c72d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:18:22.741691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 760/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:18:22 2022] DELETE /identity/v3/projects/f4d2130b9eca4276afb88764e9f3cb02 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:18:32.118376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=62 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:18:32.737477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:20:00.440717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd6bd6-4716-4a62-8e71-193e18583be7 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:00.441295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd6bd6-4716-4a62-8e71-193e18583be7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:00.441295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd6bd6-4716-4a62-8e71-193e18583be7 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:00.442571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:20:00.447692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b19a7c-ee44-436e-ac54-5cdfa3f0644e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:00.448126 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b19a7c-ee44-436e-ac54-5cdfa3f0644e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:00.448269 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b19a7c-ee44-436e-ac54-5cdfa3f0644e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:00.534428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-72b19a7c-ee44-436e-ac54-5cdfa3f0644e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:20:00.535631 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-72b19a7c-ee44-436e-ac54-5cdfa3f0644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:00.645049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:20:00.800562 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd6bd6-4716-4a62-8e71-193e18583be7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:20:00.802718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5fcd6bd6-4716-4a62-8e71-193e18583be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:00.919630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd6bd6-4716-4a62-8e71-193e18583be7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:20:00.924998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731dbe8-b506-431b-9d1a-a18242821324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:20:00.925595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731dbe8-b506-431b-9d1a-a18242821324 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:00.925873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731dbe8-b506-431b-9d1a-a18242821324 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:00.926178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731dbe8-b506-431b-9d1a-a18242821324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:00.934770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731dbe8-b506-431b-9d1a-a18242821324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:20:00.936338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731dbe8-b506-431b-9d1a-a18242821324 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:20:00.945580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 752/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:20:01.769569 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10472a8-fecd-4328-826a-9590dcbb08f6 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:01.770243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10472a8-fecd-4328-826a-9590dcbb08f6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:01.770243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10472a8-fecd-4328-826a-9590dcbb08f6 None None] PATH_INFO: `/v3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:01.771824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 762/1514] 10.222.0.73 () {54 vars in 925 bytes} [Fri Aug 19 15:20:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:20:01.778151 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57424bf-2e18-4208-b59d-4efabe0e37e5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:01.778554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57424bf-2e18-4208-b59d-4efabe0e37e5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:01.778658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57424bf-2e18-4208-b59d-4efabe0e37e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:01.786001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55b02a-6862-4461-852a-31d5fa2d0496 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:01.786428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55b02a-6862-4461-852a-31d5fa2d0496 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:01.786711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55b02a-6862-4461-852a-31d5fa2d0496 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:01.787980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 763/1515] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:20:01.792512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e578470-2550-44ca-8670-7d00ba3d055f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:01.792793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e578470-2550-44ca-8670-7d00ba3d055f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:01.793069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e578470-2550-44ca-8670-7d00ba3d055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:01.812817 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8e578470-2550-44ca-8670-7d00ba3d055f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:20:01.814013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e578470-2550-44ca-8670-7d00ba3d055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:01.822202 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 764/1516] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:20:01.840110 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f57424bf-2e18-4208-b59d-4efabe0e37e5 None None] MFA Rules not processed for user `2862a661174142d69bbdd54ee0289681`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:20:01.841305 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f57424bf-2e18-4208-b59d-4efabe0e37e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:01.907363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:20:01.912989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 753/1517] 10.222.0.73 () {58 vars in 1015 bytes} [Fri Aug 19 15:20:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:20:01.973393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e578470-2550-44ca-8670-7d00ba3d055f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:20:01.985876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e578470-2550-44ca-8670-7d00ba3d055f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:20:01.991344 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd21dd4-952c-4df3-b85f-16eaabecdea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:20:01.991938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd21dd4-952c-4df3-b85f-16eaabecdea1 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:01.992217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd21dd4-952c-4df3-b85f-16eaabecdea1 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:01.992490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd21dd4-952c-4df3-b85f-16eaabecdea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:02.001007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd21dd4-952c-4df3-b85f-16eaabecdea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:20:02.002625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd21dd4-952c-4df3-b85f-16eaabecdea1 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:20:02.012465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 765/1518] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:20:10.935606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452e7e1-4758-4b2a-9de2-4e92eb71cb3b None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:10.936213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452e7e1-4758-4b2a-9de2-4e92eb71cb3b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:10.936213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452e7e1-4758-4b2a-9de2-4e92eb71cb3b None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:10.937365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 754/1519] 10.222.0.20 () {54 vars in 961 bytes} [Fri Aug 19 15:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:20:10.943028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab90220-9682-40f9-bf84-9a3aad789261 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:10.943475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab90220-9682-40f9-bf84-9a3aad789261 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:10.943675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab90220-9682-40f9-bf84-9a3aad789261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:10.963284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-0ab90220-9682-40f9-bf84-9a3aad789261 None None] MFA Rules not processed for user `2862a661174142d69bbdd54ee0289681`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:20:10.964490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0ab90220-9682-40f9-bf84-9a3aad789261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:10.973051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 766/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Aug 19 15:20:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:20:10.980990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452e7e1-4758-4b2a-9de2-4e92eb71cb3b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:20:10.994599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452e7e1-4758-4b2a-9de2-4e92eb71cb3b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:20:10.999473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19058d-e4e5-4131-b754-137fbdbbb4d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2862a661174142d69bbdd54ee0289681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:20:11.000697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19058d-e4e5-4131-b754-137fbdbbb4d1 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:11.000981 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19058d-e4e5-4131-b754-137fbdbbb4d1 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:11.001257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19058d-e4e5-4131-b754-137fbdbbb4d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:11.009494 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19058d-e4e5-4131-b754-137fbdbbb4d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:20:11.011111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19058d-e4e5-4131-b754-137fbdbbb4d1 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:20:11.022164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 755/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:20:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:20:13.237164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebcba2-1d90-443c-9816-d4ffdc7cfc90 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:13.237669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebcba2-1d90-443c-9816-d4ffdc7cfc90 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:13.237669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebcba2-1d90-443c-9816-d4ffdc7cfc90 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:13.239030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:20:13.243739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaba999-091d-4cfc-a13d-a3db115d70de None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:13.244163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaba999-091d-4cfc-a13d-a3db115d70de None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:13.244325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaba999-091d-4cfc-a13d-a3db115d70de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:13.264209 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cdaba999-091d-4cfc-a13d-a3db115d70de None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:20:13.265393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cdaba999-091d-4cfc-a13d-a3db115d70de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:13.273122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:20:13.425103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebcba2-1d90-443c-9816-d4ffdc7cfc90 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:20:13.439740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebcba2-1d90-443c-9816-d4ffdc7cfc90 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:20:13.445201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79951b9-dc96-4eb3-bdc4-077c2696f482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:20:13.445801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79951b9-dc96-4eb3-bdc4-077c2696f482 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:13.446115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79951b9-dc96-4eb3-bdc4-077c2696f482 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:13.446389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79951b9-dc96-4eb3-bdc4-077c2696f482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:13.454918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79951b9-dc96-4eb3-bdc4-077c2696f482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:20:13.456495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79951b9-dc96-4eb3-bdc4-077c2696f482 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:20:13.466020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 768/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:20:14.294204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296ce3f-1337-4f99-b447-08f927a40f76 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:14.294762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296ce3f-1337-4f99-b447-08f927a40f76 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:14.294762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296ce3f-1337-4f99-b447-08f927a40f76 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:14.296144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 15:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:20:14.301363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b8ed-d4cc-467e-b533-939842cef8f4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:14.301788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b8ed-d4cc-467e-b533-939842cef8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:14.301939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b8ed-d4cc-467e-b533-939842cef8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:14.321715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3cf6b8ed-d4cc-467e-b533-939842cef8f4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:20:14.322936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3cf6b8ed-d4cc-467e-b533-939842cef8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:14.331242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 15:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:20:14.485691 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296ce3f-1337-4f99-b447-08f927a40f76 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:20:14.499756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296ce3f-1337-4f99-b447-08f927a40f76 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:20:14.505158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e42c4-1789-4737-aeed-f5384da8cfc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:20:14.505748 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e42c4-1789-4737-aeed-f5384da8cfc4 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:14.506046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e42c4-1789-4737-aeed-f5384da8cfc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:14.506327 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e42c4-1789-4737-aeed-f5384da8cfc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:14.514177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e42c4-1789-4737-aeed-f5384da8cfc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:20:14.515742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e42c4-1789-4737-aeed-f5384da8cfc4 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:20:14.524921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 758/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:20:18.499542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e9f4-b336-4ad6-8485-d0183f3ae221 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:18.500082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e9f4-b336-4ad6-8485-d0183f3ae221 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:18.500082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e9f4-b336-4ad6-8485-d0183f3ae221 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:18.501432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:20:18.506678 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35208360-16d6-4377-b904-878023cfc7c7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:18.507138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35208360-16d6-4377-b904-878023cfc7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:18.507252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35208360-16d6-4377-b904-878023cfc7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:18.526805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-35208360-16d6-4377-b904-878023cfc7c7 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:20:18.528062 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-35208360-16d6-4377-b904-878023cfc7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:18.536640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:20:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:20:18.826044 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e9f4-b336-4ad6-8485-d0183f3ae221 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:20:18.827880 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-93f0e9f4-b336-4ad6-8485-d0183f3ae221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:18.855297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:20:18.907147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e9f4-b336-4ad6-8485-d0183f3ae221 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:20:18.910831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95725094-a377-47e7-885c-410967735e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:20:18.911435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95725094-a377-47e7-885c-410967735e4a service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:18.911714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95725094-a377-47e7-885c-410967735e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:18.911987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95725094-a377-47e7-885c-410967735e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:18.920896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95725094-a377-47e7-885c-410967735e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:20:18.922689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95725094-a377-47e7-885c-410967735e4a service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:20:18.932070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 771/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:20:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:20:20.850482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab129d-0ce2-4cde-9b7f-7f4f1481f043 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:20.851018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab129d-0ce2-4cde-9b7f-7f4f1481f043 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:20.851018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab129d-0ce2-4cde-9b7f-7f4f1481f043 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:20.852256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:20:20.857508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9c614-db24-4f40-a670-663a697568ab None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:20.857956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9c614-db24-4f40-a670-663a697568ab None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:20.858085 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9c614-db24-4f40-a670-663a697568ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:20.877139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5ff9c614-db24-4f40-a670-663a697568ab None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:20:20.878431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5ff9c614-db24-4f40-a670-663a697568ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:20.886260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:20:21.176185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab129d-0ce2-4cde-9b7f-7f4f1481f043 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:20:21.177855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-04ab129d-0ce2-4cde-9b7f-7f4f1481f043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:21.191178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab129d-0ce2-4cde-9b7f-7f4f1481f043 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:20:21.194646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9d20f-9a89-4583-aea6-b9ab6bf07014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:20:21.195236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9d20f-9a89-4583-aea6-b9ab6bf07014 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:21.195509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9d20f-9a89-4583-aea6-b9ab6bf07014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:21.195775 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9d20f-9a89-4583-aea6-b9ab6bf07014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:21.204859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9d20f-9a89-4583-aea6-b9ab6bf07014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:20:21.206311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9d20f-9a89-4583-aea6-b9ab6bf07014 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:20:21.215403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 761/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:20:24.789236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d50b8-0ec1-4f36-801d-5668a4ce71ef None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:24.789829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d50b8-0ec1-4f36-801d-5668a4ce71ef None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:24.789829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d50b8-0ec1-4f36-801d-5668a4ce71ef None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:24.791152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:20:24.796419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c8425-b0fb-4e62-9338-16b456f310c4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:24.796866 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c8425-b0fb-4e62-9338-16b456f310c4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:24.796974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c8425-b0fb-4e62-9338-16b456f310c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:24.816478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d65c8425-b0fb-4e62-9338-16b456f310c4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:20:24.817600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d65c8425-b0fb-4e62-9338-16b456f310c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:24.825591 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:20:25.391425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d50b8-0ec1-4f36-801d-5668a4ce71ef None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:20:25.393131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-747d50b8-0ec1-4f36-801d-5668a4ce71ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:25.480318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d50b8-0ec1-4f36-801d-5668a4ce71ef None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:20:25.483883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ea62a-c070-43e8-814d-dc2b6538dd44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:20:25.484481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea62a-c070-43e8-814d-dc2b6538dd44 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:25.484757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea62a-c070-43e8-814d-dc2b6538dd44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:25.485023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea62a-c070-43e8-814d-dc2b6538dd44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:25.494515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ea62a-c070-43e8-814d-dc2b6538dd44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:20:25.495930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ea62a-c070-43e8-814d-dc2b6538dd44 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:20:25.505627 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 774/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:20:27.411688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f58d1-95f6-40f6-acfe-7dfbc12c49e2 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:27.412276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f58d1-95f6-40f6-acfe-7dfbc12c49e2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:27.412276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f58d1-95f6-40f6-acfe-7dfbc12c49e2 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:27.413571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 15:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:20:27.418941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154595ac-bc86-4506-80fe-85c76aa0b1f7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:27.419349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154595ac-bc86-4506-80fe-85c76aa0b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:27.419512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154595ac-bc86-4506-80fe-85c76aa0b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:27.438361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-154595ac-bc86-4506-80fe-85c76aa0b1f7 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:20:27.439543 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-154595ac-bc86-4506-80fe-85c76aa0b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:27.447169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 15:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:20:27.993906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f58d1-95f6-40f6-acfe-7dfbc12c49e2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:20:27.995903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-321f58d1-95f6-40f6-acfe-7dfbc12c49e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:20:28.009565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f58d1-95f6-40f6-acfe-7dfbc12c49e2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:20:28.013071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca72fd-44f3-4551-8d4a-057e63f5b198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:20:28.013675 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca72fd-44f3-4551-8d4a-057e63f5b198 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:20:28.013957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca72fd-44f3-4551-8d4a-057e63f5b198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:20:28.014286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca72fd-44f3-4551-8d4a-057e63f5b198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:20:28.024189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca72fd-44f3-4551-8d4a-057e63f5b198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:20:28.025634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca72fd-44f3-4551-8d4a-057e63f5b198 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:20:28.035409 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 764/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:20:37.433300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=66 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:20:38.030985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=34 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:21:58.122414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6beef-e7fa-4d4e-8679-dcdcaec5518c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.123068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6beef-e7fa-4d4e-8679-dcdcaec5518c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.123068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6beef-e7fa-4d4e-8679-dcdcaec5518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.147021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-25b6beef-e7fa-4d4e-8679-dcdcaec5518c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.149463 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-25b6beef-e7fa-4d4e-8679-dcdcaec5518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.158957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 776/1540] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.168104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829b3ce-8e6b-410b-881d-d174181857a0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.168657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829b3ce-8e6b-410b-881d-d174181857a0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.168657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829b3ce-8e6b-410b-881d-d174181857a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.195380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e829b3ce-8e6b-410b-881d-d174181857a0 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.196841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e829b3ce-8e6b-410b-881d-d174181857a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.213622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 765/1541] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.218113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6beef-e7fa-4d4e-8679-dcdcaec5518c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:58.229456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6beef-e7fa-4d4e-8679-dcdcaec5518c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:58.243618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cfa22-4f07-4899-998c-ebe48169e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:58.244267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cfa22-4f07-4899-998c-ebe48169e36e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.244549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cfa22-4f07-4899-998c-ebe48169e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.244819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cfa22-4f07-4899-998c-ebe48169e36e admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.245481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cfa22-4f07-4899-998c-ebe48169e36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:21:58.245783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cfa22-4f07-4899-998c-ebe48169e36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:58.251731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cfa22-4f07-4899-998c-ebe48169e36e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:58.269362 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 777/1542] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:21:58.278944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829b3ce-8e6b-410b-881d-d174181857a0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:58.294279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829b3ce-8e6b-410b-881d-d174181857a0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:58.304667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af8855-258b-42a4-a895-127ec83c5b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:58.305322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af8855-258b-42a4-a895-127ec83c5b2c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.305604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af8855-258b-42a4-a895-127ec83c5b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.305879 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af8855-258b-42a4-a895-127ec83c5b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.306581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af8855-258b-42a4-a895-127ec83c5b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:58.308874 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af8855-258b-42a4-a895-127ec83c5b2c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:58.387786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 766/1543] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:58.392895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cfa22-4f07-4899-998c-ebe48169e36e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:58.406389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cfa22-4f07-4899-998c-ebe48169e36e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:58.412363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f094-cf63-44c1-8981-0c97df4ee840 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.412660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f094-cf63-44c1-8981-0c97df4ee840 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.412943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8f094-cf63-44c1-8981-0c97df4ee840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.459477 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3fa8f094-cf63-44c1-8981-0c97df4ee840 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.460647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3fa8f094-cf63-44c1-8981-0c97df4ee840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.495016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741fb0e-4295-45bb-a1b8-f581927469a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:58.496031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741fb0e-4295-45bb-a1b8-f581927469a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.496315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741fb0e-4295-45bb-a1b8-f581927469a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.496632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741fb0e-4295-45bb-a1b8-f581927469a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.497283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741fb0e-4295-45bb-a1b8-f581927469a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:58.499645 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741fb0e-4295-45bb-a1b8-f581927469a4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:58.544981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 778/1544] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:58.550976 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dce99-41e3-46a9-b933-55addeb480e6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.551336 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dce99-41e3-46a9-b933-55addeb480e6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.551744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dce99-41e3-46a9-b933-55addeb480e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.591125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-324dce99-41e3-46a9-b933-55addeb480e6 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.592751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-324dce99-41e3-46a9-b933-55addeb480e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.619888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 779/1545] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.620898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dce99-41e3-46a9-b933-55addeb480e6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:58.632000 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 767/1546] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:21:58.633764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73b664-2773-4a10-86a0-02159682cc5c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.634277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73b664-2773-4a10-86a0-02159682cc5c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.634752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73b664-2773-4a10-86a0-02159682cc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.644334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dce99-41e3-46a9-b933-55addeb480e6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:58.659472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681318c7-787c-420f-84cc-767c56ffc48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:58.660111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681318c7-787c-420f-84cc-767c56ffc48f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.660391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681318c7-787c-420f-84cc-767c56ffc48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.660666 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681318c7-787c-420f-84cc-767c56ffc48f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.661322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681318c7-787c-420f-84cc-767c56ffc48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:58.663044 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681318c7-787c-420f-84cc-767c56ffc48f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:58.671234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9d73b664-2773-4a10-86a0-02159682cc5c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.672642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9d73b664-2773-4a10-86a0-02159682cc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.686349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 768/1547] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.687647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ba5b-e6a3-4b11-9599-cabd5c0ce35b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.687881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 780/1548] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:21:58.688011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ba5b-e6a3-4b11-9599-cabd5c0ce35b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.688236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5ba5b-e6a3-4b11-9599-cabd5c0ce35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.689685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378067f-9e14-42ed-afb2-61362829d640 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.689972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378067f-9e14-42ed-afb2-61362829d640 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.690293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378067f-9e14-42ed-afb2-61362829d640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.715357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dbb5ba5b-e6a3-4b11-9599-cabd5c0ce35b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.716471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dbb5ba5b-e6a3-4b11-9599-cabd5c0ce35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.718668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d378067f-9e14-42ed-afb2-61362829d640 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.719841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d378067f-9e14-42ed-afb2-61362829d640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.726692 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 769/1549] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.728011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cdb0e-9826-4c20-b7cb-538f728cd50d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.728292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cdb0e-9826-4c20-b7cb-538f728cd50d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.728559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cdb0e-9826-4c20-b7cb-538f728cd50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.729003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 781/1550] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.729929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378067f-9e14-42ed-afb2-61362829d640 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:58.750436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378067f-9e14-42ed-afb2-61362829d640 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:58.756573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e74cdb0e-9826-4c20-b7cb-538f728cd50d None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.756736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5afd0-e334-4fd7-8fff-cadc373d7e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:58.757333 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5afd0-e334-4fd7-8fff-cadc373d7e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.757616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5afd0-e334-4fd7-8fff-cadc373d7e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.757788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e74cdb0e-9826-4c20-b7cb-538f728cd50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.757890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5afd0-e334-4fd7-8fff-cadc373d7e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.758548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5afd0-e334-4fd7-8fff-cadc373d7e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:58.760405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5afd0-e334-4fd7-8fff-cadc373d7e29 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:58.766216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 770/1551] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.768282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548db3c-de59-45d6-9835-d99fbab07dc1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.768564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548db3c-de59-45d6-9835-d99fbab07dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.768838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548db3c-de59-45d6-9835-d99fbab07dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.772368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 782/1552] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:21:58.774180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bdcfa-3b3f-4ebd-9762-2379e66fa610 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.775699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bdcfa-3b3f-4ebd-9762-2379e66fa610 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.775997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bdcfa-3b3f-4ebd-9762-2379e66fa610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.794427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6548db3c-de59-45d6-9835-d99fbab07dc1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.795621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6548db3c-de59-45d6-9835-d99fbab07dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.796342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-670bdcfa-3b3f-4ebd-9762-2379e66fa610 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.797496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-670bdcfa-3b3f-4ebd-9762-2379e66fa610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.803516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 771/1553] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.804273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548db3c-de59-45d6-9835-d99fbab07dc1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:58.807523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 783/1554] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.808910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bdcfa-3b3f-4ebd-9762-2379e66fa610 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:58.813534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548db3c-de59-45d6-9835-d99fbab07dc1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:58.818704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2536e6-a44a-4b3e-966d-fc8369b2963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:58.819289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2536e6-a44a-4b3e-966d-fc8369b2963d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.819565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2536e6-a44a-4b3e-966d-fc8369b2963d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.819834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2536e6-a44a-4b3e-966d-fc8369b2963d admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.820064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bdcfa-3b3f-4ebd-9762-2379e66fa610 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:58.820474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2536e6-a44a-4b3e-966d-fc8369b2963d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:21:58.820777 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2536e6-a44a-4b3e-966d-fc8369b2963d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:58.821783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-af2536e6-a44a-4b3e-966d-fc8369b2963d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:21:58.821783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: warnings.warn(msg) Aug 19 15:21:58.821783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: Aug 19 15:21:58.822686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2536e6-a44a-4b3e-966d-fc8369b2963d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:58.824978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cadfe-f82c-4056-8af0-a809d4525b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:58.825582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cadfe-f82c-4056-8af0-a809d4525b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.825863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cadfe-f82c-4056-8af0-a809d4525b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.826178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cadfe-f82c-4056-8af0-a809d4525b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.826858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cadfe-f82c-4056-8af0-a809d4525b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:21:58.827168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cadfe-f82c-4056-8af0-a809d4525b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:58.828752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6cadfe-f82c-4056-8af0-a809d4525b4f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:58.834806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 772/1555] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:21:58.836143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be31bf-2c95-40a5-941c-ba49b7395f67 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.836433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be31bf-2c95-40a5-941c-ba49b7395f67 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.836793 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be31bf-2c95-40a5-941c-ba49b7395f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.843603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 784/1556] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:21:58.845140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30778-b341-4903-871f-0e7b55cafdfc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.845637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30778-b341-4903-871f-0e7b55cafdfc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.845973 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc30778-b341-4903-871f-0e7b55cafdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.856643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-36be31bf-2c95-40a5-941c-ba49b7395f67 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.857841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-36be31bf-2c95-40a5-941c-ba49b7395f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.866164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3fc30778-b341-4903-871f-0e7b55cafdfc None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.866385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 773/1557] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.873653 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be31bf-2c95-40a5-941c-ba49b7395f67 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:58.873771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3fc30778-b341-4903-871f-0e7b55cafdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.875777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 785/1558] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.877258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be31bf-2c95-40a5-941c-ba49b7395f67 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:58.877895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b061ae-f614-4c3a-9308-07566fc236d6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.878283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b061ae-f614-4c3a-9308-07566fc236d6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.878496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b061ae-f614-4c3a-9308-07566fc236d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.882003 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790979a-9a7e-4b7a-a31d-166ee54685f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:58.882675 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790979a-9a7e-4b7a-a31d-166ee54685f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.882953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790979a-9a7e-4b7a-a31d-166ee54685f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.883225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790979a-9a7e-4b7a-a31d-166ee54685f1 admin admin] PATH_INFO: `/v3/projects/dc28ed60ca8e4c30b48bdfa2af132810/users/a684c639db1f44488d1b05ee55014c71/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.897195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-74b061ae-f614-4c3a-9308-07566fc236d6 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.898334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790979a-9a7e-4b7a-a31d-166ee54685f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc28ed60ca8e4c30b48bdfa2af132810, user_id=a684c639db1f44488d1b05ee55014c71, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:58.898470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-74b061ae-f614-4c3a-9308-07566fc236d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.900973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790979a-9a7e-4b7a-a31d-166ee54685f1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:58.906617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 786/1559] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.908078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b1b5e-a2be-40c7-8ed6-b6e2da1c2947 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.908604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b1b5e-a2be-40c7-8ed6-b6e2da1c2947 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.908961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b1b5e-a2be-40c7-8ed6-b6e2da1c2947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.920231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 774/1560] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:21:58 2022] PUT /identity/v3/projects/dc28ed60ca8e4c30b48bdfa2af132810/users/a684c639db1f44488d1b05ee55014c71/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:21:58.924408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790979a-9a7e-4b7a-a31d-166ee54685f1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:58.930238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-df3b1b5e-a2be-40c7-8ed6-b6e2da1c2947 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:58.931436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df3b1b5e-a2be-40c7-8ed6-b6e2da1c2947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:58.971552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:21:58.983692 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790979a-9a7e-4b7a-a31d-166ee54685f1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:58.988894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42137de-03bd-41ad-827c-4f96ab33f8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:58.989502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42137de-03bd-41ad-827c-4f96ab33f8dd admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:58.989779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42137de-03bd-41ad-827c-4f96ab33f8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:58.990069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42137de-03bd-41ad-827c-4f96ab33f8dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:58.990706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42137de-03bd-41ad-827c-4f96ab33f8dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:21:58.991015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 787/1561] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:58.991136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42137de-03bd-41ad-827c-4f96ab33f8dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:58.991910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b1b5e-a2be-40c7-8ed6-b6e2da1c2947 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:58.992710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42137de-03bd-41ad-827c-4f96ab33f8dd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:58.996783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:21:59.003353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b1b5e-a2be-40c7-8ed6-b6e2da1c2947 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.005294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 775/1562] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:21:59.006107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42137de-03bd-41ad-827c-4f96ab33f8dd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.008684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0ef65-3972-419f-aa42-bea34fad283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.009459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0ef65-3972-419f-aa42-bea34fad283a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.009819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0ef65-3972-419f-aa42-bea34fad283a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.010196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0ef65-3972-419f-aa42-bea34fad283a admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.010887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0ef65-3972-419f-aa42-bea34fad283a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.011987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-6cf0ef65-3972-419f-aa42-bea34fad283a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:21:59.011987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 19 15:21:59.011987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: Aug 19 15:21:59.013343 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0ef65-3972-419f-aa42-bea34fad283a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.015883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42137de-03bd-41ad-827c-4f96ab33f8dd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.020812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31e297-dc86-4a07-a3e3-43423bf8ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.021398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31e297-dc86-4a07-a3e3-43423bf8ec2c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.021808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31e297-dc86-4a07-a3e3-43423bf8ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.022108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31e297-dc86-4a07-a3e3-43423bf8ec2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.022722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31e297-dc86-4a07-a3e3-43423bf8ec2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.024585 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31e297-dc86-4a07-a3e3-43423bf8ec2c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.042536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 788/1563] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:21:58 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.044021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d0243-5b83-4f04-b45b-08842c983b57 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.044306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d0243-5b83-4f04-b45b-08842c983b57 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.044629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d0243-5b83-4f04-b45b-08842c983b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.055715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 776/1564] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.056541 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31e297-dc86-4a07-a3e3-43423bf8ec2c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.065977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2d9d0243-5b83-4f04-b45b-08842c983b57 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:59.067210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2d9d0243-5b83-4f04-b45b-08842c983b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:59.118309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31e297-dc86-4a07-a3e3-43423bf8ec2c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.123060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f0244-f8e1-473e-bb57-2e6c7de21b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.123655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f0244-f8e1-473e-bb57-2e6c7de21b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.123932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f0244-f8e1-473e-bb57-2e6c7de21b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.124208 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f0244-f8e1-473e-bb57-2e6c7de21b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.124846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f0244-f8e1-473e-bb57-2e6c7de21b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:21:59.125146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f0244-f8e1-473e-bb57-2e6c7de21b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.126089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 789/1565] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:59.127621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f0244-f8e1-473e-bb57-2e6c7de21b9f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.128019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5265c1-b5eb-45af-904e-ac2767f1a299 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.128309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5265c1-b5eb-45af-904e-ac2767f1a299 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.128702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5265c1-b5eb-45af-904e-ac2767f1a299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.146312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 777/1566] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:21:59.146312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fb0ae-a869-42e7-b922-875a47c62f34 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.146312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fb0ae-a869-42e7-b922-875a47c62f34 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.146312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fb0ae-a869-42e7-b922-875a47c62f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.148901 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bc5265c1-b5eb-45af-904e-ac2767f1a299 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:59.150138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bc5265c1-b5eb-45af-904e-ac2767f1a299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:59.161545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 790/1567] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:59.161545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5265c1-b5eb-45af-904e-ac2767f1a299 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.166918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4d0fb0ae-a869-42e7-b922-875a47c62f34 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:21:59.168120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4d0fb0ae-a869-42e7-b922-875a47c62f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:21:59.172606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5265c1-b5eb-45af-904e-ac2767f1a299 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.177411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 778/1568] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:21:59.178380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fb0ae-a869-42e7-b922-875a47c62f34 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.179548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b825ff-8b81-472c-b4da-1012bc8dffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.180169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b825ff-8b81-472c-b4da-1012bc8dffa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.180455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b825ff-8b81-472c-b4da-1012bc8dffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.180725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b825ff-8b81-472c-b4da-1012bc8dffa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.181599 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b825ff-8b81-472c-b4da-1012bc8dffa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:21:59.181693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b825ff-8b81-472c-b4da-1012bc8dffa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.183458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b825ff-8b81-472c-b4da-1012bc8dffa7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.190402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fb0ae-a869-42e7-b922-875a47c62f34 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.195928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 791/1569] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:21:59.196085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f6149-4b67-44bf-b928-40dde05fa3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.196693 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f6149-4b67-44bf-b928-40dde05fa3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.197016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f6149-4b67-44bf-b928-40dde05fa3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.197285 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f6149-4b67-44bf-b928-40dde05fa3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.197713 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b825ff-8b81-472c-b4da-1012bc8dffa7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.197907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f6149-4b67-44bf-b928-40dde05fa3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.199866 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f6149-4b67-44bf-b928-40dde05fa3c9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.208129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b825ff-8b81-472c-b4da-1012bc8dffa7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.213630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae41f4d-2c7d-438b-b9b4-bf0b90556432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.214261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae41f4d-2c7d-438b-b9b4-bf0b90556432 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.214555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae41f4d-2c7d-438b-b9b4-bf0b90556432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.214823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae41f4d-2c7d-438b-b9b4-bf0b90556432 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.215474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae41f4d-2c7d-438b-b9b4-bf0b90556432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.217398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae41f4d-2c7d-438b-b9b4-bf0b90556432 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.228887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 779/1570] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.229939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f6149-4b67-44bf-b928-40dde05fa3c9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.244312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 792/1571] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.246998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae41f4d-2c7d-438b-b9b4-bf0b90556432 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.256491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae41f4d-2c7d-438b-b9b4-bf0b90556432 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.296940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f6149-4b67-44bf-b928-40dde05fa3c9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.302065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604ec42-30b0-453f-bb5d-ba67b39007a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.302665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604ec42-30b0-453f-bb5d-ba67b39007a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.302940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604ec42-30b0-453f-bb5d-ba67b39007a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.303208 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604ec42-30b0-453f-bb5d-ba67b39007a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.303933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604ec42-30b0-453f-bb5d-ba67b39007a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.305253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-c604ec42-30b0-453f-bb5d-ba67b39007a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:21:59.305253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: warnings.warn(msg) Aug 19 15:21:59.305253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: Aug 19 15:21:59.306420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604ec42-30b0-453f-bb5d-ba67b39007a0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.319386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b2a80-9e19-471c-b27f-e0e1c69cc4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.320114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b2a80-9e19-471c-b27f-e0e1c69cc4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.320428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b2a80-9e19-471c-b27f-e0e1c69cc4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.320755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b2a80-9e19-471c-b27f-e0e1c69cc4b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.321412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b2a80-9e19-471c-b27f-e0e1c69cc4b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:21:59.321763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b2a80-9e19-471c-b27f-e0e1c69cc4b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.323402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b2a80-9e19-471c-b27f-e0e1c69cc4b7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.327625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 780/1572] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.328434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604ec42-30b0-453f-bb5d-ba67b39007a0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.338056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 793/1573] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:21:59.338056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b2a80-9e19-471c-b27f-e0e1c69cc4b7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.345940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604ec42-30b0-453f-bb5d-ba67b39007a0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.346640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b2a80-9e19-471c-b27f-e0e1c69cc4b7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.351016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfef73e-ad7f-48e7-b49b-d6b0a7d9306a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.351710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfef73e-ad7f-48e7-b49b-d6b0a7d9306a admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.351851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087952e-4192-4178-ba66-45f08d2d454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.351996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfef73e-ad7f-48e7-b49b-d6b0a7d9306a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.352272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfef73e-ad7f-48e7-b49b-d6b0a7d9306a admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.352415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087952e-4192-4178-ba66-45f08d2d454c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.352699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087952e-4192-4178-ba66-45f08d2d454c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.352974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087952e-4192-4178-ba66-45f08d2d454c admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.353076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfef73e-ad7f-48e7-b49b-d6b0a7d9306a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.353609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087952e-4192-4178-ba66-45f08d2d454c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:21:59.353915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087952e-4192-4178-ba66-45f08d2d454c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.354912 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfef73e-ad7f-48e7-b49b-d6b0a7d9306a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.355596 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087952e-4192-4178-ba66-45f08d2d454c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.370056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 794/1574] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:21:59.370056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087952e-4192-4178-ba66-45f08d2d454c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.382637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:21:59.393805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 781/1575] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/projects => generated 393 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.394673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfef73e-ad7f-48e7-b49b-d6b0a7d9306a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.398197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:21:59.428989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087952e-4192-4178-ba66-45f08d2d454c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.456913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfef73e-ad7f-48e7-b49b-d6b0a7d9306a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.461962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6547e00-883c-466f-868e-96466e12e848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.462601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547e00-883c-466f-868e-96466e12e848 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.462883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547e00-883c-466f-868e-96466e12e848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.463152 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547e00-883c-466f-868e-96466e12e848 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.463768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6547e00-883c-466f-868e-96466e12e848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.465680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6547e00-883c-466f-868e-96466e12e848 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.477440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1f97b-1ba1-4654-aa13-4473cdef925c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.478093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1f97b-1ba1-4654-aa13-4473cdef925c service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.478370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1f97b-1ba1-4654-aa13-4473cdef925c service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.478640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1f97b-1ba1-4654-aa13-4473cdef925c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.489244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1f97b-1ba1-4654-aa13-4473cdef925c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.490642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1f97b-1ba1-4654-aa13-4473cdef925c service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.495177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 782/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.499174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6547e00-883c-466f-868e-96466e12e848 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.500447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 795/1577] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:21:59.501234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1f97b-1ba1-4654-aa13-4473cdef925c service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.510079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1f97b-1ba1-4654-aa13-4473cdef925c service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.568271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6547e00-883c-466f-868e-96466e12e848 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.573434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43aae2-b5a0-4a44-86c4-23357a614286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.574082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43aae2-b5a0-4a44-86c4-23357a614286 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.574370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43aae2-b5a0-4a44-86c4-23357a614286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.574639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43aae2-b5a0-4a44-86c4-23357a614286 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.575320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43aae2-b5a0-4a44-86c4-23357a614286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.577245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43aae2-b5a0-4a44-86c4-23357a614286 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.578429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ce71a-238f-495b-b771-4b2f632ca9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.579045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ce71a-238f-495b-b771-4b2f632ca9ff admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.579377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ce71a-238f-495b-b771-4b2f632ca9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.579650 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ce71a-238f-495b-b771-4b2f632ca9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.580531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ce71a-238f-495b-b771-4b2f632ca9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.582283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ce71a-238f-495b-b771-4b2f632ca9ff admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.597774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 796/1578] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:21:59.597774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ce71a-238f-495b-b771-4b2f632ca9ff admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.612662 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ce71a-238f-495b-b771-4b2f632ca9ff admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.612897 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 783/1579] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.613730 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43aae2-b5a0-4a44-86c4-23357a614286 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.617562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923776bf-b62f-467f-9e1e-55f869e8084a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.618206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923776bf-b62f-467f-9e1e-55f869e8084a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.618486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923776bf-b62f-467f-9e1e-55f869e8084a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.618757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923776bf-b62f-467f-9e1e-55f869e8084a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.619823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923776bf-b62f-467f-9e1e-55f869e8084a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.620980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923776bf-b62f-467f-9e1e-55f869e8084a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.624383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43aae2-b5a0-4a44-86c4-23357a614286 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.630124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30faa8-185b-456b-b2a3-e8c4006c3ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.631065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30faa8-185b-456b-b2a3-e8c4006c3ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.631632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 797/1580] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:21:59.631767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30faa8-185b-456b-b2a3-e8c4006c3ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.631863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30faa8-185b-456b-b2a3-e8c4006c3ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.632230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923776bf-b62f-467f-9e1e-55f869e8084a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.632787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30faa8-185b-456b-b2a3-e8c4006c3ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.634948 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30faa8-185b-456b-b2a3-e8c4006c3ab1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.642890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923776bf-b62f-467f-9e1e-55f869e8084a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.647993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071d09-39e3-4e3e-af8f-68696a6d4200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.648680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071d09-39e3-4e3e-af8f-68696a6d4200 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.649021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071d09-39e3-4e3e-af8f-68696a6d4200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.649363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071d09-39e3-4e3e-af8f-68696a6d4200 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.650074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071d09-39e3-4e3e-af8f-68696a6d4200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.652039 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071d09-39e3-4e3e-af8f-68696a6d4200 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.668601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 784/1581] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.669704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30faa8-185b-456b-b2a3-e8c4006c3ab1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.695325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 798/1582] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.697236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071d09-39e3-4e3e-af8f-68696a6d4200 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.740482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:21:59.754554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:21:59.755853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30faa8-185b-456b-b2a3-e8c4006c3ab1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.774064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071d09-39e3-4e3e-af8f-68696a6d4200 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.780379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050943a7-b85c-4b80-b4ee-3fef43a06ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.781188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050943a7-b85c-4b80-b4ee-3fef43a06ebc admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.781586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050943a7-b85c-4b80-b4ee-3fef43a06ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.781961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050943a7-b85c-4b80-b4ee-3fef43a06ebc admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.782752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050943a7-b85c-4b80-b4ee-3fef43a06ebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.785963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050943a7-b85c-4b80-b4ee-3fef43a06ebc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.812652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 799/1583] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.813517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050943a7-b85c-4b80-b4ee-3fef43a06ebc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.824784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050943a7-b85c-4b80-b4ee-3fef43a06ebc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.824963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50fa16-fad1-420e-bb40-c504ec6f8ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.825398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fa16-fad1-420e-bb40-c504ec6f8ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.825740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fa16-fad1-420e-bb40-c504ec6f8ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.826188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fa16-fad1-420e-bb40-c504ec6f8ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.826947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50fa16-fad1-420e-bb40-c504ec6f8ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.828865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50fa16-fad1-420e-bb40-c504ec6f8ee0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.831034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e117e7-bddc-484b-838a-667fe8527425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.831755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e117e7-bddc-484b-838a-667fe8527425 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.832103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e117e7-bddc-484b-838a-667fe8527425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.832474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e117e7-bddc-484b-838a-667fe8527425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.833205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e117e7-bddc-484b-838a-667fe8527425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.834974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e117e7-bddc-484b-838a-667fe8527425 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.854596 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 800/1584] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:21:59.854596 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e117e7-bddc-484b-838a-667fe8527425 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.862840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 785/1585] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.863225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50fa16-fad1-420e-bb40-c504ec6f8ee0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.866773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e117e7-bddc-484b-838a-667fe8527425 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.873725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611dfb-cd1d-4439-8ebc-2c0aea055bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.874497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611dfb-cd1d-4439-8ebc-2c0aea055bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.874785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611dfb-cd1d-4439-8ebc-2c0aea055bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.874942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50fa16-fad1-420e-bb40-c504ec6f8ee0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.875314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611dfb-cd1d-4439-8ebc-2c0aea055bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.876333 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c611dfb-cd1d-4439-8ebc-2c0aea055bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.879134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c611dfb-cd1d-4439-8ebc-2c0aea055bfe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.881004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92045-39d1-472f-9e33-e28562212386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.881714 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92045-39d1-472f-9e33-e28562212386 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.882077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92045-39d1-472f-9e33-e28562212386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.882452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92045-39d1-472f-9e33-e28562212386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.883196 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab92045-39d1-472f-9e33-e28562212386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.884869 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab92045-39d1-472f-9e33-e28562212386 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.900846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 786/1586] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:21:59.900846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92045-39d1-472f-9e33-e28562212386 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.901850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 801/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:21:59.902949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611dfb-cd1d-4439-8ebc-2c0aea055bfe admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.914320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92045-39d1-472f-9e33-e28562212386 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.915316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611dfb-cd1d-4439-8ebc-2c0aea055bfe admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.919581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42960c-bf0e-4322-95ec-da7897ece157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.920299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42960c-bf0e-4322-95ec-da7897ece157 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.920686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42960c-bf0e-4322-95ec-da7897ece157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.921066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42960c-bf0e-4322-95ec-da7897ece157 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.921290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a74542-072f-4720-ad16-f4301b4b1a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.922074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42960c-bf0e-4322-95ec-da7897ece157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.922509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a74542-072f-4720-ad16-f4301b4b1a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.922942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a74542-072f-4720-ad16-f4301b4b1a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.923388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a74542-072f-4720-ad16-f4301b4b1a64 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.924186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a74542-072f-4720-ad16-f4301b4b1a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.924518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42960c-bf0e-4322-95ec-da7897ece157 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.926626 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a74542-072f-4720-ad16-f4301b4b1a64 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.951531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 787/1588] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/users => generated 286 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.951531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42960c-bf0e-4322-95ec-da7897ece157 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.959429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 802/1589] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:21:59 2022] POST /identity/v3/users => generated 292 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:21:59.959429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a74542-072f-4720-ad16-f4301b4b1a64 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.964165 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42960c-bf0e-4322-95ec-da7897ece157 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.969973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019b3f7-2388-494e-b709-b14913583daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.970198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a74542-072f-4720-ad16-f4301b4b1a64 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:21:59.971795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019b3f7-2388-494e-b709-b14913583daf admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.971795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019b3f7-2388-494e-b709-b14913583daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.972037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019b3f7-2388-494e-b709-b14913583daf admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.972800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019b3f7-2388-494e-b709-b14913583daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.974742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019b3f7-2388-494e-b709-b14913583daf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:21:59.976659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6111c75-6863-440e-bac2-fd3ff68c76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:21:59.977203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6111c75-6863-440e-bac2-fd3ff68c76ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:21:59.977704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6111c75-6863-440e-bac2-fd3ff68c76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:21:59.978250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6111c75-6863-440e-bac2-fd3ff68c76ac admin admin] PATH_INFO: `/v3/projects/0969a034b7804c69ad11629bc9c42268/users/957c3a73b4f14927905fde65c9c844cb/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:21:59.989092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 788/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:21:59.990008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019b3f7-2388-494e-b709-b14913583daf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:21:59.997397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6111c75-6863-440e-bac2-fd3ff68c76ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0969a034b7804c69ad11629bc9c42268, user_id=957c3a73b4f14927905fde65c9c844cb, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:21:59.998440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-a6111c75-6863-440e-bac2-fd3ff68c76ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:21:59.998440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 19 15:21:59.998440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: Aug 19 15:22:00.000600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6111c75-6863-440e-bac2-fd3ff68c76ac admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.005199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019b3f7-2388-494e-b709-b14913583daf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.011801 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbd548-69aa-45c7-8c17-9bc794786540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.012677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbd548-69aa-45c7-8c17-9bc794786540 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.012953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbd548-69aa-45c7-8c17-9bc794786540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.013279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbd548-69aa-45c7-8c17-9bc794786540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.014116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbd548-69aa-45c7-8c17-9bc794786540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.015622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbd548-69aa-45c7-8c17-9bc794786540 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.021295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 803/1591] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:21:59 2022] PUT /identity/v3/projects/0969a034b7804c69ad11629bc9c42268/users/957c3a73b4f14927905fde65c9c844cb/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:00.022425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6111c75-6863-440e-bac2-fd3ff68c76ac admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.027385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 789/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:00.028212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbd548-69aa-45c7-8c17-9bc794786540 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.038567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbd548-69aa-45c7-8c17-9bc794786540 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.093962 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6111c75-6863-440e-bac2-fd3ff68c76ac admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.098753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10f83-7fdf-4eda-af1f-fc409cd8d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.099676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10f83-7fdf-4eda-af1f-fc409cd8d8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.099952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10f83-7fdf-4eda-af1f-fc409cd8d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.100244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa10f83-7fdf-4eda-af1f-fc409cd8d8b5 admin admin] PATH_INFO: `/v3/projects/0644f2b040084d2fb59af93bc1068d46/users/4cc851578b1348b5bd41b611d53642e2/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.101450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1398c-27c4-4b47-a7d4-767e9d755196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.102094 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1398c-27c4-4b47-a7d4-767e9d755196 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.102388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1398c-27c4-4b47-a7d4-767e9d755196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.102666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1398c-27c4-4b47-a7d4-767e9d755196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.103318 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1398c-27c4-4b47-a7d4-767e9d755196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.104929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1398c-27c4-4b47-a7d4-767e9d755196 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.116579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa10f83-7fdf-4eda-af1f-fc409cd8d8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0644f2b040084d2fb59af93bc1068d46, user_id=4cc851578b1348b5bd41b611d53642e2, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.118197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 790/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:00.119136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa10f83-7fdf-4eda-af1f-fc409cd8d8b5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.119767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1398c-27c4-4b47-a7d4-767e9d755196 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.132815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1398c-27c4-4b47-a7d4-767e9d755196 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.134922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 804/1594] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:00 2022] PUT /identity/v3/projects/0644f2b040084d2fb59af93bc1068d46/users/4cc851578b1348b5bd41b611d53642e2/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:00.135548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10f83-7fdf-4eda-af1f-fc409cd8d8b5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.174779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:00.222413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4b024-6278-4265-8230-68a22548fe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.223040 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4b024-6278-4265-8230-68a22548fe05 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.223318 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4b024-6278-4265-8230-68a22548fe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.223633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4b024-6278-4265-8230-68a22548fe05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.224157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:00.224818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4b024-6278-4265-8230-68a22548fe05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.226624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4b024-6278-4265-8230-68a22548fe05 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.232611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa10f83-7fdf-4eda-af1f-fc409cd8d8b5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.239298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 791/1595] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:00.239784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508b50d-5e6b-493c-82b6-af94bb626ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.240467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4b024-6278-4265-8230-68a22548fe05 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.240601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508b50d-5e6b-493c-82b6-af94bb626ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.241001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508b50d-5e6b-493c-82b6-af94bb626ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.241374 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508b50d-5e6b-493c-82b6-af94bb626ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.242448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508b50d-5e6b-493c-82b6-af94bb626ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.244197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508b50d-5e6b-493c-82b6-af94bb626ffa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.252360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4b024-6278-4265-8230-68a22548fe05 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.257170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcaa12-391f-486a-8de3-20ed2f755da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.257843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcaa12-391f-486a-8de3-20ed2f755da9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.257987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 805/1596] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:00.258287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcaa12-391f-486a-8de3-20ed2f755da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.258634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcaa12-391f-486a-8de3-20ed2f755da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.259693 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcaa12-391f-486a-8de3-20ed2f755da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.259913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd1bc2-b2da-4bc7-8213-4f230369a2ec None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.260240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd1bc2-b2da-4bc7-8213-4f230369a2ec None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.260641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd1bc2-b2da-4bc7-8213-4f230369a2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.261915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcaa12-391f-486a-8de3-20ed2f755da9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.273444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 792/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:00.277500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcaa12-391f-486a-8de3-20ed2f755da9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.284568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-becd1bc2-b2da-4bc7-8213-4f230369a2ec None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:00.285580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-becd1bc2-b2da-4bc7-8213-4f230369a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:00.289033 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcaa12-391f-486a-8de3-20ed2f755da9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.294596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a713cf-f47c-4230-8203-557ab05b751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.295325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a713cf-f47c-4230-8203-557ab05b751a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.295673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a713cf-f47c-4230-8203-557ab05b751a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.296007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a713cf-f47c-4230-8203-557ab05b751a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.296736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a713cf-f47c-4230-8203-557ab05b751a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.298277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 806/1598] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:00.299106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a713cf-f47c-4230-8203-557ab05b751a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.299927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd1bc2-b2da-4bc7-8213-4f230369a2ec None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.313205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 793/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:00.314759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7972a6-3c61-46cb-bac5-fc201ab2d7ec None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.315108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7972a6-3c61-46cb-bac5-fc201ab2d7ec None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.315454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7972a6-3c61-46cb-bac5-fc201ab2d7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.321890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd1bc2-b2da-4bc7-8213-4f230369a2ec None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.327381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146e2ec-dd35-4bb1-99c2-7cd564f05932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.328183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146e2ec-dd35-4bb1-99c2-7cd564f05932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.328546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146e2ec-dd35-4bb1-99c2-7cd564f05932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.328717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146e2ec-dd35-4bb1-99c2-7cd564f05932 admin admin] PATH_INFO: `/v3/projects/7f5f3049ce26467dbb70cfc2c57833d1/users/9546b7c51b1747ff8d6f5faca3857b34/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.341532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ce7972a6-3c61-46cb-bac5-fc201ab2d7ec None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:00.343088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ce7972a6-3c61-46cb-bac5-fc201ab2d7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:00.349490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146e2ec-dd35-4bb1-99c2-7cd564f05932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f5f3049ce26467dbb70cfc2c57833d1, user_id=9546b7c51b1747ff8d6f5faca3857b34, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.353569 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 794/1600] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:00.354519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7972a6-3c61-46cb-bac5-fc201ab2d7ec None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.363879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146e2ec-dd35-4bb1-99c2-7cd564f05932 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.367338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7972a6-3c61-46cb-bac5-fc201ab2d7ec None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.375651 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bafca-c76f-42e6-a980-f77a8766a8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.376280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bafca-c76f-42e6-a980-f77a8766a8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.376579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bafca-c76f-42e6-a980-f77a8766a8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.376852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bafca-c76f-42e6-a980-f77a8766a8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.377507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bafca-c76f-42e6-a980-f77a8766a8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.379320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bafca-c76f-42e6-a980-f77a8766a8c2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.395926 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 807/1601] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:00 2022] PUT /identity/v3/projects/7f5f3049ce26467dbb70cfc2c57833d1/users/9546b7c51b1747ff8d6f5faca3857b34/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:00.396140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 795/1602] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:00.396140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bafca-c76f-42e6-a980-f77a8766a8c2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.396309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146e2ec-dd35-4bb1-99c2-7cd564f05932 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.406632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bafca-c76f-42e6-a980-f77a8766a8c2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.474557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811efb9-8957-44bc-9a86-1671378c600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.475348 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811efb9-8957-44bc-9a86-1671378c600c admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.475643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811efb9-8957-44bc-9a86-1671378c600c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.475913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811efb9-8957-44bc-9a86-1671378c600c admin admin] PATH_INFO: `/v3/projects/71dff115693445b483b5c4f7fe476bcb/users/c2c4ba36ac1240e0bbca86690a69b64c/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.479813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146e2ec-dd35-4bb1-99c2-7cd564f05932 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.486020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf1d9e-cac9-4ecb-81dd-937a6b6d1d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.486657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf1d9e-cac9-4ecb-81dd-937a6b6d1d7c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.486938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf1d9e-cac9-4ecb-81dd-937a6b6d1d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.487209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf1d9e-cac9-4ecb-81dd-937a6b6d1d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.487878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf1d9e-cac9-4ecb-81dd-937a6b6d1d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.489467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf1d9e-cac9-4ecb-81dd-937a6b6d1d7c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.493319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811efb9-8957-44bc-9a86-1671378c600c admin admin] RBAC: Authorizing `identity:create_grant(project_id=71dff115693445b483b5c4f7fe476bcb, user_id=c2c4ba36ac1240e0bbca86690a69b64c, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.496084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811efb9-8957-44bc-9a86-1671378c600c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.501967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 808/1603] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:00.502926 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf1d9e-cac9-4ecb-81dd-937a6b6d1d7c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.518069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 796/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:00 2022] PUT /identity/v3/projects/71dff115693445b483b5c4f7fe476bcb/users/c2c4ba36ac1240e0bbca86690a69b64c/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:00.520309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811efb9-8957-44bc-9a86-1671378c600c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.579568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf1d9e-cac9-4ecb-81dd-937a6b6d1d7c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.625202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811efb9-8957-44bc-9a86-1671378c600c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.634667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b3e60-bd63-482a-bd79-6adc87b1f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.635581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b3e60-bd63-482a-bd79-6adc87b1f878 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.635871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b3e60-bd63-482a-bd79-6adc87b1f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.636150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b3e60-bd63-482a-bd79-6adc87b1f878 admin admin] PATH_INFO: `/v3/projects/f38bebb8f23b401b8205010647b7cdc5/users/336b111f4b854a21ad3d9fe8fcff6f8b/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.638742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c19c5-4092-4a6d-a850-ca415b8d22f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.640047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c19c5-4092-4a6d-a850-ca415b8d22f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.640340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c19c5-4092-4a6d-a850-ca415b8d22f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.640619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c19c5-4092-4a6d-a850-ca415b8d22f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.653975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c19c5-4092-4a6d-a850-ca415b8d22f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.654696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b3e60-bd63-482a-bd79-6adc87b1f878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38bebb8f23b401b8205010647b7cdc5, user_id=336b111f4b854a21ad3d9fe8fcff6f8b, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.655847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c19c5-4092-4a6d-a850-ca415b8d22f1 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.657863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b3e60-bd63-482a-bd79-6adc87b1f878 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.661610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:00.671817 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 809/1605] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:00.672720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c19c5-4092-4a6d-a850-ca415b8d22f1 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.680534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 797/1606] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:00 2022] PUT /identity/v3/projects/f38bebb8f23b401b8205010647b7cdc5/users/336b111f4b854a21ad3d9fe8fcff6f8b/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:00.682469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b3e60-bd63-482a-bd79-6adc87b1f878 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.686188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c19c5-4092-4a6d-a850-ca415b8d22f1 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.704381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:00.780257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b3e60-bd63-482a-bd79-6adc87b1f878 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.788145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a57b3e-1fca-4531-a7e8-33fbe69175df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.788856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57b3e-1fca-4531-a7e8-33fbe69175df admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.789652 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57b3e-1fca-4531-a7e8-33fbe69175df admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.789949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a57b3e-1fca-4531-a7e8-33fbe69175df admin admin] PATH_INFO: `/v3/projects/2d14042e8bdc4caa86ba0abf808a76de/users/e8c29656bc3945c6b6adcefc9fcfbd70/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.793771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef4042-69b7-4c8f-ab92-85feca04a4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.796673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef4042-69b7-4c8f-ab92-85feca04a4db service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.797635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef4042-69b7-4c8f-ab92-85feca04a4db service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.798011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef4042-69b7-4c8f-ab92-85feca04a4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.820733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a57b3e-1fca-4531-a7e8-33fbe69175df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d14042e8bdc4caa86ba0abf808a76de, user_id=e8c29656bc3945c6b6adcefc9fcfbd70, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.823987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a57b3e-1fca-4531-a7e8-33fbe69175df admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.830313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef4042-69b7-4c8f-ab92-85feca04a4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:00.832117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef4042-69b7-4c8f-ab92-85feca04a4db service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:00.854840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 798/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:00 2022] PUT /identity/v3/projects/2d14042e8bdc4caa86ba0abf808a76de/users/e8c29656bc3945c6b6adcefc9fcfbd70/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:00.855295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 810/1608] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:00.856238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef4042-69b7-4c8f-ab92-85feca04a4db service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:00.856411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9cbb5-5919-4848-9850-4d55970cd3e4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.856726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9cbb5-5919-4848-9850-4d55970cd3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.856984 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9cbb5-5919-4848-9850-4d55970cd3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:00.872876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef4042-69b7-4c8f-ab92-85feca04a4db service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:00.904505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a0e9cbb5-5919-4848-9850-4d55970cd3e4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:00.905922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a0e9cbb5-5919-4848-9850-4d55970cd3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:00.971736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204f761-a580-44e9-9c02-55f2a4d9b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:00.972428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204f761-a580-44e9-9c02-55f2a4d9b8e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:00.972770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204f761-a580-44e9-9c02-55f2a4d9b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:00.972966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204f761-a580-44e9-9c02-55f2a4d9b8e2 admin admin] PATH_INFO: `/v3/projects/10e412f6fae54678b77bb7e6062be724/users/88fe6f87dde64109b3823b83093537d2/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.002233 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204f761-a580-44e9-9c02-55f2a4d9b8e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e412f6fae54678b77bb7e6062be724, user_id=88fe6f87dde64109b3823b83093537d2, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:01.006083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0204f761-a580-44e9-9c02-55f2a4d9b8e2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:01.035866 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 811/1609] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:00 2022] PUT /identity/v3/projects/10e412f6fae54678b77bb7e6062be724/users/88fe6f87dde64109b3823b83093537d2/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:01.036230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95a097-078d-433e-9246-dc6ddb901b2e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.036804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95a097-078d-433e-9246-dc6ddb901b2e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.037338 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95a097-078d-433e-9246-dc6ddb901b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.055604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 799/1610] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:01.060100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee69de2-781d-4790-bfca-7e82c3ddcf3a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.060394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee69de2-781d-4790-bfca-7e82c3ddcf3a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.060673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee69de2-781d-4790-bfca-7e82c3ddcf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.071483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ff95a097-078d-433e-9246-dc6ddb901b2e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:01.072832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ff95a097-078d-433e-9246-dc6ddb901b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:01.091843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0ee69de2-781d-4790-bfca-7e82c3ddcf3a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:01.093964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ee69de2-781d-4790-bfca-7e82c3ddcf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:01.177063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 812/1611] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:01.179166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85abe5-ed72-4194-8eaa-3b3186df80a8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.179641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85abe5-ed72-4194-8eaa-3b3186df80a8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.179927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85abe5-ed72-4194-8eaa-3b3186df80a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.203650 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 800/1612] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:01.204997 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cf96-b2ec-498d-b532-4efb30a4ffa6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.205282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cf96-b2ec-498d-b532-4efb30a4ffa6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.205555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09cf96-b2ec-498d-b532-4efb30a4ffa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.224541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-af85abe5-ed72-4194-8eaa-3b3186df80a8 None None] MFA Rules not processed for user `e8c29656bc3945c6b6adcefc9fcfbd70`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:01.225904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-af85abe5-ed72-4194-8eaa-3b3186df80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:01.249437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8b09cf96-b2ec-498d-b532-4efb30a4ffa6 None None] MFA Rules not processed for user `88fe6f87dde64109b3823b83093537d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:01.250353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8b09cf96-b2ec-498d-b532-4efb30a4ffa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:01.261325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:01.301303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:01.415676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 813/1613] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:01.415676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85abe5-ed72-4194-8eaa-3b3186df80a8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:01.433362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 801/1614] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:01.433362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09cf96-b2ec-498d-b532-4efb30a4ffa6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:01.515596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09cf96-b2ec-498d-b532-4efb30a4ffa6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:01.528697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85abe5-ed72-4194-8eaa-3b3186df80a8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:01.534977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7820b3-fd9f-4fc7-9fa9-87be3c9619b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:01.536703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7820b3-fd9f-4fc7-9fa9-87be3c9619b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.536703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7820b3-fd9f-4fc7-9fa9-87be3c9619b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.536703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7820b3-fd9f-4fc7-9fa9-87be3c9619b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.540998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834a305-b498-4ade-9d94-24569bba9fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:01.542021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834a305-b498-4ade-9d94-24569bba9fbf service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.543571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834a305-b498-4ade-9d94-24569bba9fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.543964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834a305-b498-4ade-9d94-24569bba9fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.550840 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7820b3-fd9f-4fc7-9fa9-87be3c9619b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:01.553193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7820b3-fd9f-4fc7-9fa9-87be3c9619b9 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:01.576769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834a305-b498-4ade-9d94-24569bba9fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:01.579521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834a305-b498-4ade-9d94-24569bba9fbf service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:01.582789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 814/1615] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:01.583721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7820b3-fd9f-4fc7-9fa9-87be3c9619b9 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:01.593864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7820b3-fd9f-4fc7-9fa9-87be3c9619b9 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:01.598365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 802/1616] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:01.600076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b175e964-18f7-41dc-935f-5ccb2ca26460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:01.600299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aa4aa-04e6-4ddd-b814-723c7ed5a86a None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.600646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aa4aa-04e6-4ddd-b814-723c7ed5a86a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.600773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175e964-18f7-41dc-935f-5ccb2ca26460 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.600927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aa4aa-04e6-4ddd-b814-723c7ed5a86a None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.601039 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175e964-18f7-41dc-935f-5ccb2ca26460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.601229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b175e964-18f7-41dc-935f-5ccb2ca26460 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.601860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175e964-18f7-41dc-935f-5ccb2ca26460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:01.602639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 803/1617] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 19 15:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:22:01.604244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aa4aa-04e6-4ddd-b814-723c7ed5a86a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:01.612991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b175e964-18f7-41dc-935f-5ccb2ca26460 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:01.621765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aa4aa-04e6-4ddd-b814-723c7ed5a86a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:01.627099 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391e411-3d67-4191-a362-f98fa0f065a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:01.628560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e411-3d67-4191-a362-f98fa0f065a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.628560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e411-3d67-4191-a362-f98fa0f065a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.628560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e411-3d67-4191-a362-f98fa0f065a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.646002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391e411-3d67-4191-a362-f98fa0f065a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:01.647944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391e411-3d67-4191-a362-f98fa0f065a6 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:01.654387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 815/1618] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:01 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:01.657060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628495-d31b-422a-91ef-26d31d5e721a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.657060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628495-d31b-422a-91ef-26d31d5e721a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.657060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51628495-d31b-422a-91ef-26d31d5e721a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.674649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 804/1619] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:01.677261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391e411-3d67-4191-a362-f98fa0f065a6 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:01.695900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391e411-3d67-4191-a362-f98fa0f065a6 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:01.720375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-51628495-d31b-422a-91ef-26d31d5e721a None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:01.721676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-51628495-d31b-422a-91ef-26d31d5e721a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:01.787621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b64b83-3e6e-4e17-857a-0b765c5f71f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:01.788655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b64b83-3e6e-4e17-857a-0b765c5f71f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.790060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b64b83-3e6e-4e17-857a-0b765c5f71f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.790704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b64b83-3e6e-4e17-857a-0b765c5f71f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.791661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b64b83-3e6e-4e17-857a-0b765c5f71f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:01.794469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b64b83-3e6e-4e17-857a-0b765c5f71f8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:01.826705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 805/1620] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:01 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:01.830998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b64b83-3e6e-4e17-857a-0b765c5f71f8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:01.844147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b64b83-3e6e-4e17-857a-0b765c5f71f8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:01.850743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbb8d0-c4f6-406f-86a5-dcd77ad05db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:01.852659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbb8d0-c4f6-406f-86a5-dcd77ad05db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.853213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbb8d0-c4f6-406f-86a5-dcd77ad05db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.853779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbb8d0-c4f6-406f-86a5-dcd77ad05db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.854489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 816/1621] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 19 15:22:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:01.854944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbb8d0-c4f6-406f-86a5-dcd77ad05db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:01.857264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbb8d0-c4f6-406f-86a5-dcd77ad05db6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:01.864090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51628495-d31b-422a-91ef-26d31d5e721a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:01.873971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 806/1622] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:22:01.875385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbb8d0-c4f6-406f-86a5-dcd77ad05db6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:01.886836 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51628495-d31b-422a-91ef-26d31d5e721a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:01.888872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbb8d0-c4f6-406f-86a5-dcd77ad05db6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:01.895670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511f723-acda-4a81-840a-e8440a0ac8e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:01.895849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5713edc-a887-41d1-a41f-7fb0295097ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:01.896691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511f723-acda-4a81-840a-e8440a0ac8e5 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.896823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713edc-a887-41d1-a41f-7fb0295097ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:01.897166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713edc-a887-41d1-a41f-7fb0295097ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.897406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511f723-acda-4a81-840a-e8440a0ac8e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:01.897627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713edc-a887-41d1-a41f-7fb0295097ca admin admin] PATH_INFO: `/v3/projects/60eed99ef6394b18a92e31aca74db650/users/dafad1a445114aab8459434f936c924c/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.898348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511f723-acda-4a81-840a-e8440a0ac8e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:01.924523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5713edc-a887-41d1-a41f-7fb0295097ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eed99ef6394b18a92e31aca74db650, user_id=dafad1a445114aab8459434f936c924c, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:01.929643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5713edc-a887-41d1-a41f-7fb0295097ca admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:01.934410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:01.954958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 807/1623] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:01 2022] PUT /identity/v3/projects/60eed99ef6394b18a92e31aca74db650/users/dafad1a445114aab8459434f936c924c/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:01.959229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5713edc-a887-41d1-a41f-7fb0295097ca admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:01.962406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:02.028182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511f723-acda-4a81-840a-e8440a0ac8e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:02.032056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511f723-acda-4a81-840a-e8440a0ac8e5 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:02.045948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 817/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:02.118512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5713edc-a887-41d1-a41f-7fb0295097ca admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:02.143924 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2b960-9576-4be1-9f80-7560f4c5718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:02.144867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2b960-9576-4be1-9f80-7560f4c5718f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:02.145260 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2b960-9576-4be1-9f80-7560f4c5718f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:02.145824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2b960-9576-4be1-9f80-7560f4c5718f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:02.146634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2b960-9576-4be1-9f80-7560f4c5718f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:02.149189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2b960-9576-4be1-9f80-7560f4c5718f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:02.164167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 808/1625] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:02.169855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511f723-acda-4a81-840a-e8440a0ac8e5 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:02.221107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511f723-acda-4a81-840a-e8440a0ac8e5 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:02.238934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90342a8-259b-4a08-9af4-ae779beea41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:02.243500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90342a8-259b-4a08-9af4-ae779beea41e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:02.244007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90342a8-259b-4a08-9af4-ae779beea41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:02.247222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90342a8-259b-4a08-9af4-ae779beea41e admin admin] PATH_INFO: `/v3/projects/60eed99ef6394b18a92e31aca74db650/users/dafad1a445114aab8459434f936c924c/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:02.258076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90342a8-259b-4a08-9af4-ae779beea41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eed99ef6394b18a92e31aca74db650, user_id=dafad1a445114aab8459434f936c924c, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:02.262020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90342a8-259b-4a08-9af4-ae779beea41e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:02.292969 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 818/1626] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:02 2022] PUT /identity/v3/projects/60eed99ef6394b18a92e31aca74db650/users/dafad1a445114aab8459434f936c924c/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:02.304020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ad608-b5b6-4bca-8446-0d1a05317c57 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:02.305449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ad608-b5b6-4bca-8446-0d1a05317c57 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:02.305935 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ad608-b5b6-4bca-8446-0d1a05317c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:02.407400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2c3ad608-b5b6-4bca-8446-0d1a05317c57 None None] MFA Rules not processed for user `dafad1a445114aab8459434f936c924c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:02.408795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2c3ad608-b5b6-4bca-8446-0d1a05317c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:02.545214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b8235-ed4a-4727-928a-580bcdc3a78d None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:02.545683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b8235-ed4a-4727-928a-580bcdc3a78d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:02.545974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b8235-ed4a-4727-928a-580bcdc3a78d None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:02.547705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 819/1627] 10.222.0.20 () {54 vars in 912 bytes} [Fri Aug 19 15:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:22:02.558488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a3e00-3e40-49e3-afde-eca957d7eaaf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:02.561871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a3e00-3e40-49e3-afde-eca957d7eaaf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:02.561871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a3e00-3e40-49e3-afde-eca957d7eaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:02.576507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 809/1628] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:02.577520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ad608-b5b6-4bca-8446-0d1a05317c57 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:02.595370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6c8a3e00-3e40-49e3-afde-eca957d7eaaf None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:02.598819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6c8a3e00-3e40-49e3-afde-eca957d7eaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:02.724756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ad608-b5b6-4bca-8446-0d1a05317c57 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:02.741145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f43458-3481-4184-9b1a-f304d704b1bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:02.741770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43458-3481-4184-9b1a-f304d704b1bc service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:02.742070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43458-3481-4184-9b1a-f304d704b1bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:02.742349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43458-3481-4184-9b1a-f304d704b1bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:02.755177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 820/1629] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:22:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:22:02.765969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f43458-3481-4184-9b1a-f304d704b1bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:02.767339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f43458-3481-4184-9b1a-f304d704b1bc service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:02.780115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a3e00-3e40-49e3-afde-eca957d7eaaf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:02.791591 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 810/1630] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:02.793586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a3e00-3e40-49e3-afde-eca957d7eaaf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:02.801512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad21bf-fed4-440e-8981-af76c439a69d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:02.802523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad21bf-fed4-440e-8981-af76c439a69d service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:02.803051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad21bf-fed4-440e-8981-af76c439a69d service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:02.803418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad21bf-fed4-440e-8981-af76c439a69d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:02.820669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad21bf-fed4-440e-8981-af76c439a69d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:02.822527 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad21bf-fed4-440e-8981-af76c439a69d service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:02.896437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 821/1631] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:03.422818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f43458-3481-4184-9b1a-f304d704b1bc service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:03.464668 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:03.571845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f43458-3481-4184-9b1a-f304d704b1bc service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:03.589797 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:03.590771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:03.591232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:03.591741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] PATH_INFO: `/v3/users/e8c29656bc3945c6b6adcefc9fcfbd70` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:03.593130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c29656bc3945c6b6adcefc9fcfbd70)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:03.596124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:03.690171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c29656bc3945c6b6adcefc9fcfbd70'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:03.691725 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c29656bc3945c6b6adcefc9fcfbd70'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:03.693292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c29656bc3945c6b6adcefc9fcfbd70'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:03.706145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c29656bc3945c6b6adcefc9fcfbd70'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:03.718059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c29656bc3945c6b6adcefc9fcfbd70'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:03.754287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 811/1632] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:03 2022] DELETE /identity/v3/users/e8c29656bc3945c6b6adcefc9fcfbd70 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:03.758405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23bcf8-4ed4-4516-bff8-0091156dccb5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:03.759448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23bcf8-4ed4-4516-bff8-0091156dccb5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:03.760045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23bcf8-4ed4-4516-bff8-0091156dccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:03.784375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5e23bcf8-4ed4-4516-bff8-0091156dccb5 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:03.786321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5e23bcf8-4ed4-4516-bff8-0091156dccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:03.924142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 822/1633] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:22:03.965473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:03.969557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:04.024513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246b88-1789-40c3-8dc7-6233ee98d1d6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:04.024903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246b88-1789-40c3-8dc7-6233ee98d1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:04.025278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246b88-1789-40c3-8dc7-6233ee98d1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:04.145051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-49246b88-1789-40c3-8dc7-6233ee98d1d6 None None] MFA Rules not processed for user `4cc851578b1348b5bd41b611d53642e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:04.146489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-49246b88-1789-40c3-8dc7-6233ee98d1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:04.201341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfee0b7-3baf-4d42-be34-10720899572c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:04.214939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c26aec-74e7-439d-ae6a-688ad2a7ea29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:04.215721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c26aec-74e7-439d-ae6a-688ad2a7ea29 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:04.216099 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c26aec-74e7-439d-ae6a-688ad2a7ea29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:04.216463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c26aec-74e7-439d-ae6a-688ad2a7ea29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:04.220494 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:04.237942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c26aec-74e7-439d-ae6a-688ad2a7ea29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:04.242722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c26aec-74e7-439d-ae6a-688ad2a7ea29 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:04.269998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 812/1634] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:04.328216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 823/1635] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:04 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:04.334121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c26aec-74e7-439d-ae6a-688ad2a7ea29 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:04.334723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-21c26aec-74e7-439d-ae6a-688ad2a7ea29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:04.360272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c26aec-74e7-439d-ae6a-688ad2a7ea29 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:04.379230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f434a3-aee6-46e5-a5c8-ec53adb4993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:04.381428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f434a3-aee6-46e5-a5c8-ec53adb4993a admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:04.381725 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f434a3-aee6-46e5-a5c8-ec53adb4993a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:04.382157 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f434a3-aee6-46e5-a5c8-ec53adb4993a admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:04.383091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f434a3-aee6-46e5-a5c8-ec53adb4993a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:04.387831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f434a3-aee6-46e5-a5c8-ec53adb4993a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:04.477367 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 813/1636] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:04 2022] POST /identity/v3/projects => generated 403 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:04.480989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49246b88-1789-40c3-8dc7-6233ee98d1d6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:04.500201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49246b88-1789-40c3-8dc7-6233ee98d1d6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:04.565424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b004e9c-369d-4de4-95a1-c730bef07e8e None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:04.565775 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b004e9c-369d-4de4-95a1-c730bef07e8e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:04.565987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b004e9c-369d-4de4-95a1-c730bef07e8e None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:04.572838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 814/1637] 10.222.0.20 () {54 vars in 962 bytes} [Fri Aug 19 15:22:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:22:04.591929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad17916-28ca-43e0-9b2b-ce4e3ab9328d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:04.592243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad17916-28ca-43e0-9b2b-ce4e3ab9328d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:04.592525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad17916-28ca-43e0-9b2b-ce4e3ab9328d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:04.691150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5ad17916-28ca-43e0-9b2b-ce4e3ab9328d None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:04.692422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ad17916-28ca-43e0-9b2b-ce4e3ab9328d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:04.719796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:04.724138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2c26e-60d0-4aa0-a586-af6a3067f309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:04.724779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2c26e-60d0-4aa0-a586-af6a3067f309 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:04.725056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2c26e-60d0-4aa0-a586-af6a3067f309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:04.725330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2c26e-60d0-4aa0-a586-af6a3067f309 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:04.726056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2c26e-60d0-4aa0-a586-af6a3067f309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:04.731558 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2c26e-60d0-4aa0-a586-af6a3067f309 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:04.790308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 824/1638] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:04 2022] POST /identity/v3/users => generated 308 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:04.801128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2c26e-60d0-4aa0-a586-af6a3067f309 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:04.836609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2c26e-60d0-4aa0-a586-af6a3067f309 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:04.850355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 815/1639] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Aug 19 15:22:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:04.851012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703aabb-0fe3-456c-8aec-b87a07a31141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:04.851642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703aabb-0fe3-456c-8aec-b87a07a31141 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:04.851927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703aabb-0fe3-456c-8aec-b87a07a31141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:04.852204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703aabb-0fe3-456c-8aec-b87a07a31141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:04.854065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703aabb-0fe3-456c-8aec-b87a07a31141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:04.856100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb58e9-61ea-46dd-8e39-ce3b412fa55f None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:04.856392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb58e9-61ea-46dd-8e39-ce3b412fa55f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:04.856665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb58e9-61ea-46dd-8e39-ce3b412fa55f None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:04.858460 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 816/1640] 10.222.0.20 () {54 vars in 912 bytes} [Fri Aug 19 15:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:22:04.858587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703aabb-0fe3-456c-8aec-b87a07a31141 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:04.865187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc68c74-3ab9-4821-9153-6e7f1a8e3dac None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:04.865493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc68c74-3ab9-4821-9153-6e7f1a8e3dac None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:04.865799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc68c74-3ab9-4821-9153-6e7f1a8e3dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:04.882497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 825/1641] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:04.886956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703aabb-0fe3-456c-8aec-b87a07a31141 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:04.909686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4dc68c74-3ab9-4821-9153-6e7f1a8e3dac None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:04.913172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4dc68c74-3ab9-4821-9153-6e7f1a8e3dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:04.913571 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703aabb-0fe3-456c-8aec-b87a07a31141 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:04.924675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbf3d1-a0e2-4704-a17a-71687e3d085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:04.924675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbf3d1-a0e2-4704-a17a-71687e3d085c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:04.924955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbf3d1-a0e2-4704-a17a-71687e3d085c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:04.925465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbf3d1-a0e2-4704-a17a-71687e3d085c admin admin] PATH_INFO: `/v3/projects/8b565dfd504c4d8d8300d272d0c55ec4/users/2d1a3b97b8824e318b285a1880b38b3c/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:04.934563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 817/1642] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:22:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:04.950085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc68c74-3ab9-4821-9153-6e7f1a8e3dac None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:04.951557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4dc68c74-3ab9-4821-9153-6e7f1a8e3dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:04.974914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbf3d1-a0e2-4704-a17a-71687e3d085c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b565dfd504c4d8d8300d272d0c55ec4, user_id=2d1a3b97b8824e318b285a1880b38b3c, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:04.977987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbf3d1-a0e2-4704-a17a-71687e3d085c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:05.009088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 826/1643] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:04 2022] PUT /identity/v3/projects/8b565dfd504c4d8d8300d272d0c55ec4/users/2d1a3b97b8824e318b285a1880b38b3c/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:05.012957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbf3d1-a0e2-4704-a17a-71687e3d085c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:05.083217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc68c74-3ab9-4821-9153-6e7f1a8e3dac None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:05.158149 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbf3d1-a0e2-4704-a17a-71687e3d085c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:05.165016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf117c0-290f-42a2-bcc6-021a71308f9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:05.166236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf117c0-290f-42a2-bcc6-021a71308f9b service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:05.166732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf117c0-290f-42a2-bcc6-021a71308f9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:05.167636 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf117c0-290f-42a2-bcc6-021a71308f9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:05.171888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f5c3e-e8f5-4366-9671-06ecb7a03dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:05.172728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f5c3e-e8f5-4366-9671-06ecb7a03dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:05.174595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f5c3e-e8f5-4366-9671-06ecb7a03dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:05.176009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f5c3e-e8f5-4366-9671-06ecb7a03dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:05.176009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f5c3e-e8f5-4366-9671-06ecb7a03dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:05.182491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f5c3e-e8f5-4366-9671-06ecb7a03dcb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:05.210171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 827/1644] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:05.215338 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f5c3e-e8f5-4366-9671-06ecb7a03dcb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:05.239793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f5c3e-e8f5-4366-9671-06ecb7a03dcb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:05.252602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97c749-ad7e-41bb-bc5d-82d59a084a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:05.253401 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97c749-ad7e-41bb-bc5d-82d59a084a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:05.256151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97c749-ad7e-41bb-bc5d-82d59a084a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:05.256538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97c749-ad7e-41bb-bc5d-82d59a084a6c admin admin] PATH_INFO: `/v3/projects/8b565dfd504c4d8d8300d272d0c55ec4/users/2d1a3b97b8824e318b285a1880b38b3c/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:05.259994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97c749-ad7e-41bb-bc5d-82d59a084a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b565dfd504c4d8d8300d272d0c55ec4, user_id=2d1a3b97b8824e318b285a1880b38b3c, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:05.265063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97c749-ad7e-41bb-bc5d-82d59a084a6c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:05.299124 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 828/1645] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:05 2022] PUT /identity/v3/projects/8b565dfd504c4d8d8300d272d0c55ec4/users/2d1a3b97b8824e318b285a1880b38b3c/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:22:05.369087 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf117c0-290f-42a2-bcc6-021a71308f9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:05.371209 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf117c0-290f-42a2-bcc6-021a71308f9b service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:05.389126 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:05.403899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 818/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:22:07.590000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97c749-ad7e-41bb-bc5d-82d59a084a6c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:07.594952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ba97c749-ad7e-41bb-bc5d-82d59a084a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:07.605444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:07.763132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97c749-ad7e-41bb-bc5d-82d59a084a6c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:07.781590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:07.783316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:07.783536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:07.783863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] PATH_INFO: `/v3/projects/2d14042e8bdc4caa86ba0abf808a76de` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:07.787249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d14042e8bdc4caa86ba0abf808a76de)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:07.789699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:07.934522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d14042e8bdc4caa86ba0abf808a76de', 'request_id': 'req-0a760fa3-02e6-416c-9e21-97fcc0129d99'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:07.959422 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d14042e8bdc4caa86ba0abf808a76de', 'request_id': 'req-0a760fa3-02e6-416c-9e21-97fcc0129d99'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:07.979618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d14042e8bdc4caa86ba0abf808a76de', 'request_id': 'req-0a760fa3-02e6-416c-9e21-97fcc0129d99'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:08.003779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] The token cache is being invalidate because project 2d14042e8bdc4caa86ba0abf808a76de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:08.004034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:08.004881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0a760fa3-02e6-416c-9e21-97fcc0129d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:08.006685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 829/1647] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:07 2022] DELETE /identity/v3/projects/2d14042e8bdc4caa86ba0abf808a76de => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:08.010651 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf117c0-290f-42a2-bcc6-021a71308f9b service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:08.027496 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf117c0-290f-42a2-bcc6-021a71308f9b service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:08.208434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:08.212730 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:08.213275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:08.213743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] PATH_INFO: `/v3/users/dafad1a445114aab8459434f936c924c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:08.215564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dafad1a445114aab8459434f936c924c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:08.217872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:08.400851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dafad1a445114aab8459434f936c924c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:08.401677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dafad1a445114aab8459434f936c924c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:08.403671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dafad1a445114aab8459434f936c924c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:08.432085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dafad1a445114aab8459434f936c924c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:08.450039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dafad1a445114aab8459434f936c924c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:08.486685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 819/1648] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:08 2022] DELETE /identity/v3/users/dafad1a445114aab8459434f936c924c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:09.822437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e2f68-701a-43ba-a223-887032d20d38 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:09.822923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e2f68-701a-43ba-a223-887032d20d38 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:09.823011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e2f68-701a-43ba-a223-887032d20d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:09.881261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a31e2f68-701a-43ba-a223-887032d20d38 None None] MFA Rules not processed for user `a684c639db1f44488d1b05ee55014c71`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:09.882550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a31e2f68-701a-43ba-a223-887032d20d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:09.989002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 830/1649] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:10.004792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:10.006675 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:10.270164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63280362-b488-441c-8245-55076efd22d9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:10.278239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6a7f2-8aed-4b49-9ee6-8233ec398f28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:10.279195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6a7f2-8aed-4b49-9ee6-8233ec398f28 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:10.279631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6a7f2-8aed-4b49-9ee6-8233ec398f28 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:10.280045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6a7f2-8aed-4b49-9ee6-8233ec398f28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:10.292688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6a7f2-8aed-4b49-9ee6-8233ec398f28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:10.294599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6a7f2-8aed-4b49-9ee6-8233ec398f28 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:10.315170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e2f68-701a-43ba-a223-887032d20d38 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:10.317822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a31e2f68-701a-43ba-a223-887032d20d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:10.342325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 820/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:10.359013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:10.441403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e2f68-701a-43ba-a223-887032d20d38 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:10.453154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:10.453812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:10.454126 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:10.455127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] PATH_INFO: `/v3/users/88fe6f87dde64109b3823b83093537d2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:10.458815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88fe6f87dde64109b3823b83093537d2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:10.460419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: WARNING py.warnings [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:22:10.460419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: warnings.warn(msg) Aug 19 15:22:10.460419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: Aug 19 15:22:10.461663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:10.586475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88fe6f87dde64109b3823b83093537d2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:10.607195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88fe6f87dde64109b3823b83093537d2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:10.632787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88fe6f87dde64109b3823b83093537d2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:10.647434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88fe6f87dde64109b3823b83093537d2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:10.648215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88fe6f87dde64109b3823b83093537d2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:10.658897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 831/1651] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:10 2022] DELETE /identity/v3/users/88fe6f87dde64109b3823b83093537d2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:22:10.660420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e398-7913-42fd-acd3-4e033bac9bac None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:10.660714 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e398-7913-42fd-acd3-4e033bac9bac None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:10.661069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533e398-7913-42fd-acd3-4e033bac9bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:10.671298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:10.692213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c533e398-7913-42fd-acd3-4e033bac9bac None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:10.693402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c533e398-7913-42fd-acd3-4e033bac9bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:10.845335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 821/1652] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:22:10.898751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:10.902468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:11.044174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfdfa6-7f11-46c7-acaa-7f396707c889 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:11.053090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7d986-e9a2-4f46-957f-3efc74fcdde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:11.054700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d986-e9a2-4f46-957f-3efc74fcdde2 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:11.055590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d986-e9a2-4f46-957f-3efc74fcdde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:11.055590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7d986-e9a2-4f46-957f-3efc74fcdde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:11.077572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7d986-e9a2-4f46-957f-3efc74fcdde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:11.082374 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7d986-e9a2-4f46-957f-3efc74fcdde2 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:11.111941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 832/1653] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:11.124374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248bdbb-963c-4ddc-bf81-60bd54d047ff None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:11.125367 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248bdbb-963c-4ddc-bf81-60bd54d047ff None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:11.125780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248bdbb-963c-4ddc-bf81-60bd54d047ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:11.212483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7248bdbb-963c-4ddc-bf81-60bd54d047ff None None] MFA Rules not processed for user `2d1a3b97b8824e318b285a1880b38b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:11.213638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7248bdbb-963c-4ddc-bf81-60bd54d047ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:11.438322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 822/1654] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:11 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:11.570249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7d986-e9a2-4f46-957f-3efc74fcdde2 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:11.576909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fed7d986-e9a2-4f46-957f-3efc74fcdde2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:11.611676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7d986-e9a2-4f46-957f-3efc74fcdde2 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:11.623245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:11.626162 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:11.636365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:11.636917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] PATH_INFO: `/v3/projects/60eed99ef6394b18a92e31aca74db650` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:11.638456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] RBAC: Authorizing `identity:delete_project(project_id=60eed99ef6394b18a92e31aca74db650)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:11.640566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:11.745273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:11.766855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60eed99ef6394b18a92e31aca74db650', 'request_id': 'req-71635f7a-d1c1-4b75-8f8c-1af64929751d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:11.773868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60eed99ef6394b18a92e31aca74db650', 'request_id': 'req-71635f7a-d1c1-4b75-8f8c-1af64929751d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:11.795914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60eed99ef6394b18a92e31aca74db650', 'request_id': 'req-71635f7a-d1c1-4b75-8f8c-1af64929751d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:11.825008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] The token cache is being invalidate because project 60eed99ef6394b18a92e31aca74db650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:11.825008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:11.825852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-71635f7a-d1c1-4b75-8f8c-1af64929751d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:11.829353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 833/1655] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:11 2022] DELETE /identity/v3/projects/60eed99ef6394b18a92e31aca74db650 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:11.834258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfdcec-d0a7-4df7-9e9e-3fa418958de3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:11.834550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfdcec-d0a7-4df7-9e9e-3fa418958de3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:11.834822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfdcec-d0a7-4df7-9e9e-3fa418958de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:11.882824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6ddfdcec-d0a7-4df7-9e9e-3fa418958de3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:11.885861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6ddfdcec-d0a7-4df7-9e9e-3fa418958de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:12.050322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 823/1656] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:12.057965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee147-6842-44cc-989b-81fc2cfce3c3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:12.058855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee147-6842-44cc-989b-81fc2cfce3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:12.059304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee147-6842-44cc-989b-81fc2cfce3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:12.094444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-921ee147-6842-44cc-989b-81fc2cfce3c3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:12.096554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-921ee147-6842-44cc-989b-81fc2cfce3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:12.108183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 834/1657] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:12.113403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfdcec-d0a7-4df7-9e9e-3fa418958de3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:12.126170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfdcec-d0a7-4df7-9e9e-3fa418958de3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:12.140524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877af82-f1e2-41b8-9d66-a2d9849adfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:12.141500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877af82-f1e2-41b8-9d66-a2d9849adfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:12.141979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877af82-f1e2-41b8-9d66-a2d9849adfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:12.142558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877af82-f1e2-41b8-9d66-a2d9849adfa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:12.143368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877af82-f1e2-41b8-9d66-a2d9849adfa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:22:12.143817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877af82-f1e2-41b8-9d66-a2d9849adfa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:12.146532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877af82-f1e2-41b8-9d66-a2d9849adfa2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:12.175626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 824/1658] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:22:12.178946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ee147-6842-44cc-989b-81fc2cfce3c3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:12.192373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ee147-6842-44cc-989b-81fc2cfce3c3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:12.214673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b809f-372d-464e-af8f-3d1f5ded5065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:12.215557 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b809f-372d-464e-af8f-3d1f5ded5065 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:12.215992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b809f-372d-464e-af8f-3d1f5ded5065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:12.216566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b809f-372d-464e-af8f-3d1f5ded5065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:12.217361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b809f-372d-464e-af8f-3d1f5ded5065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:12.223730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b809f-372d-464e-af8f-3d1f5ded5065 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:12.304869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 835/1659] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:12 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:12.308800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877af82-f1e2-41b8-9d66-a2d9849adfa2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:12.323993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877af82-f1e2-41b8-9d66-a2d9849adfa2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:12.355207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:12.476873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5335764-9620-4e95-b7d7-6398748c990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:12.477906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5335764-9620-4e95-b7d7-6398748c990b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:12.478415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b809f-372d-464e-af8f-3d1f5ded5065 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:12.479470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5335764-9620-4e95-b7d7-6398748c990b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:12.480225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5335764-9620-4e95-b7d7-6398748c990b admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:12.484922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5335764-9620-4e95-b7d7-6398748c990b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:12.492516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef8b809f-372d-464e-af8f-3d1f5ded5065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:12.493889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5335764-9620-4e95-b7d7-6398748c990b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:12.555690 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 825/1660] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:12 2022] POST /identity/v3/users => generated 296 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:12.562941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5335764-9620-4e95-b7d7-6398748c990b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:12.576733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b809f-372d-464e-af8f-3d1f5ded5065 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:12.593823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:12.596447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:12.597556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:12.599125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] PATH_INFO: `/v3/projects/10e412f6fae54678b77bb7e6062be724` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:12.601264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e412f6fae54678b77bb7e6062be724)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:12.601630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5335764-9620-4e95-b7d7-6398748c990b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:12.607706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:12.615134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9be54f-13bf-4a30-b558-a7beecf566c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:12.618298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9be54f-13bf-4a30-b558-a7beecf566c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:12.619238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9be54f-13bf-4a30-b558-a7beecf566c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:12.619351 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9be54f-13bf-4a30-b558-a7beecf566c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:12.621107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9be54f-13bf-4a30-b558-a7beecf566c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:12.624024 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9be54f-13bf-4a30-b558-a7beecf566c0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:12.654335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 826/1661] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:12.664653 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9be54f-13bf-4a30-b558-a7beecf566c0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:12.682962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9be54f-13bf-4a30-b558-a7beecf566c0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:12.700922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d263d7-3a39-45b8-87b1-b91abb2d0bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:12.701613 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d263d7-3a39-45b8-87b1-b91abb2d0bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:12.701894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d263d7-3a39-45b8-87b1-b91abb2d0bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:12.702234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d263d7-3a39-45b8-87b1-b91abb2d0bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:12.706673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d263d7-3a39-45b8-87b1-b91abb2d0bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:12.708662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d263d7-3a39-45b8-87b1-b91abb2d0bb7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:12.742114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e412f6fae54678b77bb7e6062be724', 'request_id': 'req-5dfe0224-2f07-4967-bcc2-2657807ba63e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:12.756790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 827/1662] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:12.760244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d263d7-3a39-45b8-87b1-b91abb2d0bb7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:12.763266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e412f6fae54678b77bb7e6062be724', 'request_id': 'req-5dfe0224-2f07-4967-bcc2-2657807ba63e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:12.784735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e412f6fae54678b77bb7e6062be724', 'request_id': 'req-5dfe0224-2f07-4967-bcc2-2657807ba63e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:12.788640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d263d7-3a39-45b8-87b1-b91abb2d0bb7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:12.815119 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] The token cache is being invalidate because project 10e412f6fae54678b77bb7e6062be724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:12.815624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:12.816457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5dfe0224-2f07-4967-bcc2-2657807ba63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:12.820985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 836/1663] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:12 2022] DELETE /identity/v3/projects/10e412f6fae54678b77bb7e6062be724 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:12.827938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883a84e-a8b9-4dcf-b163-db88cb0643b1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:12.828384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883a84e-a8b9-4dcf-b163-db88cb0643b1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:12.828778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e883a84e-a8b9-4dcf-b163-db88cb0643b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:12.883908 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e883a84e-a8b9-4dcf-b163-db88cb0643b1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:12.888364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e883a84e-a8b9-4dcf-b163-db88cb0643b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:12.936461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a97fc-31c1-415e-a92a-4d7014d117c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:12.937176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a97fc-31c1-415e-a92a-4d7014d117c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:12.937454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a97fc-31c1-415e-a92a-4d7014d117c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:12.937871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a97fc-31c1-415e-a92a-4d7014d117c5 admin admin] PATH_INFO: `/v3/projects/630a7a7ffa274415ac7d1c1fefd5b843/users/cf9c3cb2823f468eafd20bc5bf08d788/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:12.980385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a97fc-31c1-415e-a92a-4d7014d117c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630a7a7ffa274415ac7d1c1fefd5b843, user_id=cf9c3cb2823f468eafd20bc5bf08d788, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:12.984987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a97fc-31c1-415e-a92a-4d7014d117c5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:13.018217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 828/1664] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:12 2022] PUT /identity/v3/projects/630a7a7ffa274415ac7d1c1fefd5b843/users/cf9c3cb2823f468eafd20bc5bf08d788/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:13.029152 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f59aae-1478-4731-abc0-8df43d750e30 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:13.030983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f59aae-1478-4731-abc0-8df43d750e30 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:13.031440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f59aae-1478-4731-abc0-8df43d750e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:13.042087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 837/1665] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:13.049847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb2568-8013-4ec3-831f-8927b18dbfdf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:13.050489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb2568-8013-4ec3-831f-8927b18dbfdf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:13.051042 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb2568-8013-4ec3-831f-8927b18dbfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:13.102350 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f8f59aae-1478-4731-abc0-8df43d750e30 None None] MFA Rules not processed for user `cf9c3cb2823f468eafd20bc5bf08d788`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:13.111244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f8f59aae-1478-4731-abc0-8df43d750e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:13.112566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7deb2568-8013-4ec3-831f-8927b18dbfdf None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:13.117900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7deb2568-8013-4ec3-831f-8927b18dbfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:13.175216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:13.244204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:13.253475 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 829/1666] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:13.257372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f59aae-1478-4731-abc0-8df43d750e30 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:13.259140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f8f59aae-1478-4731-abc0-8df43d750e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:13.274419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 838/1667] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:22:13.280785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb2568-8013-4ec3-831f-8927b18dbfdf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:13.288633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f59aae-1478-4731-abc0-8df43d750e30 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:13.294361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb2568-8013-4ec3-831f-8927b18dbfdf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:13.298953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbeec3-7447-4eeb-a1d9-fbd2a8c0a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:13.299722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbeec3-7447-4eeb-a1d9-fbd2a8c0a503 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:13.300109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbeec3-7447-4eeb-a1d9-fbd2a8c0a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:13.300784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbeec3-7447-4eeb-a1d9-fbd2a8c0a503 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:13.301587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbeec3-7447-4eeb-a1d9-fbd2a8c0a503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:13.303616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dbeec3-7447-4eeb-a1d9-fbd2a8c0a503 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:13.308368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f56848-51c7-4ce9-968a-7e9b90cf8713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:13.308999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f56848-51c7-4ce9-968a-7e9b90cf8713 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:13.309281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f56848-51c7-4ce9-968a-7e9b90cf8713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:13.309561 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f56848-51c7-4ce9-968a-7e9b90cf8713 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:13.310611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f56848-51c7-4ce9-968a-7e9b90cf8713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:22:13.310611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f56848-51c7-4ce9-968a-7e9b90cf8713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:13.312164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f56848-51c7-4ce9-968a-7e9b90cf8713 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:13.347689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 839/1668] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:22:13.351923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 830/1669] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:13 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:13.355822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f56848-51c7-4ce9-968a-7e9b90cf8713 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:13.360843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbeec3-7447-4eeb-a1d9-fbd2a8c0a503 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:13.376045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f56848-51c7-4ce9-968a-7e9b90cf8713 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:13.495225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dbeec3-7447-4eeb-a1d9-fbd2a8c0a503 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:13.499031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f70fe-d6fc-4710-9621-2d827a18bd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:13.499673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f70fe-d6fc-4710-9621-2d827a18bd57 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:13.499961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f70fe-d6fc-4710-9621-2d827a18bd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:13.500244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f70fe-d6fc-4710-9621-2d827a18bd57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:13.500889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f70fe-d6fc-4710-9621-2d827a18bd57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:13.505015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f70fe-d6fc-4710-9621-2d827a18bd57 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:13.510363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c2b3a-8b74-4d60-98c1-2d1417b3b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:13.510998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c2b3a-8b74-4d60-98c1-2d1417b3b9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:13.511282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c2b3a-8b74-4d60-98c1-2d1417b3b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:13.511555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c2b3a-8b74-4d60-98c1-2d1417b3b9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:13.512203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c2b3a-8b74-4d60-98c1-2d1417b3b9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:13.514146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c2b3a-8b74-4d60-98c1-2d1417b3b9b5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:13.575096 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 831/1670] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:13 2022] POST /identity/v3/users => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:13.581074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c2b3a-8b74-4d60-98c1-2d1417b3b9b5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:13.589970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 840/1671] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:13 2022] POST /identity/v3/projects => generated 375 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:13.597051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f70fe-d6fc-4710-9621-2d827a18bd57 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:13.615725 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c2b3a-8b74-4d60-98c1-2d1417b3b9b5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:13.737701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f70fe-d6fc-4710-9621-2d827a18bd57 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:13.742950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4de6a1-ea08-41a0-8cc0-f4a65234b542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:13.743684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de6a1-ea08-41a0-8cc0-f4a65234b542 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:13.744260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de6a1-ea08-41a0-8cc0-f4a65234b542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:13.744544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4de6a1-ea08-41a0-8cc0-f4a65234b542 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:13.745174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4de6a1-ea08-41a0-8cc0-f4a65234b542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:13.748348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4de6a1-ea08-41a0-8cc0-f4a65234b542 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:13.762170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686fac4-80a4-411d-b8d8-d962ca8ae5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:13.762860 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686fac4-80a4-411d-b8d8-d962ca8ae5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:13.763192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686fac4-80a4-411d-b8d8-d962ca8ae5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:13.763470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686fac4-80a4-411d-b8d8-d962ca8ae5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:13.764206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686fac4-80a4-411d-b8d8-d962ca8ae5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:13.765872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686fac4-80a4-411d-b8d8-d962ca8ae5f9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:13.777256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 841/1672] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:13 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:13.782244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4de6a1-ea08-41a0-8cc0-f4a65234b542 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:13.798253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 832/1673] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:13.799338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686fac4-80a4-411d-b8d8-d962ca8ae5f9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:13.804671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4de6a1-ea08-41a0-8cc0-f4a65234b542 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:13.811641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383827a-e8cf-4ae1-9d4f-e2e58d9b6938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:13.812278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383827a-e8cf-4ae1-9d4f-e2e58d9b6938 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:13.812561 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383827a-e8cf-4ae1-9d4f-e2e58d9b6938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:13.812832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383827a-e8cf-4ae1-9d4f-e2e58d9b6938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:13.813484 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383827a-e8cf-4ae1-9d4f-e2e58d9b6938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:13.815913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383827a-e8cf-4ae1-9d4f-e2e58d9b6938 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:13.827874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 842/1674] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:13.830043 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686fac4-80a4-411d-b8d8-d962ca8ae5f9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:13.834723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383827a-e8cf-4ae1-9d4f-e2e58d9b6938 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:13.845046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f074-3127-4d22-923f-032f18c76b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:13.845882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f074-3127-4d22-923f-032f18c76b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:13.846168 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f074-3127-4d22-923f-032f18c76b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:13.846459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f074-3127-4d22-923f-032f18c76b31 admin admin] PATH_INFO: `/v3/projects/e68eddcbde9841929aec02506ab918d8/users/851ad9185c1644258d21a249c4d9ce69/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:13.852206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383827a-e8cf-4ae1-9d4f-e2e58d9b6938 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:13.858456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbbfb9-65c0-407e-92c5-1b5f0453ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:13.859093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbbfb9-65c0-407e-92c5-1b5f0453ef62 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:13.859534 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbbfb9-65c0-407e-92c5-1b5f0453ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:13.859815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cbbfb9-65c0-407e-92c5-1b5f0453ef62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:13.861184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbbfb9-65c0-407e-92c5-1b5f0453ef62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:13.863092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cbbfb9-65c0-407e-92c5-1b5f0453ef62 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:13.879313 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4f074-3127-4d22-923f-032f18c76b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68eddcbde9841929aec02506ab918d8, user_id=851ad9185c1644258d21a249c4d9ce69, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:13.882396 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4f074-3127-4d22-923f-032f18c76b31 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:13.883002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 843/1675] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:13.887306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbbfb9-65c0-407e-92c5-1b5f0453ef62 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:13.894939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:13.908508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 833/1676] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:13 2022] PUT /identity/v3/projects/e68eddcbde9841929aec02506ab918d8/users/851ad9185c1644258d21a249c4d9ce69/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:13.909500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f074-3127-4d22-923f-032f18c76b31 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:13.922407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cbbfb9-65c0-407e-92c5-1b5f0453ef62 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:14.023910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:14.069152 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f074-3127-4d22-923f-032f18c76b31 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:14.085721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68374875-8ff5-4302-aff8-60dd6f382a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:14.087148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68374875-8ff5-4302-aff8-60dd6f382a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:14.088340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68374875-8ff5-4302-aff8-60dd6f382a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:14.090371 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68374875-8ff5-4302-aff8-60dd6f382a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:14.091202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68374875-8ff5-4302-aff8-60dd6f382a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:14.094797 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68374875-8ff5-4302-aff8-60dd6f382a37 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:14.111530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94724a2c-1418-45b2-ad4b-08442b456076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:14.113475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724a2c-1418-45b2-ad4b-08442b456076 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:14.117138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724a2c-1418-45b2-ad4b-08442b456076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:14.118528 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94724a2c-1418-45b2-ad4b-08442b456076 admin admin] PATH_INFO: `/v3/projects/3e5bc557f00f448eacf84b9b1652995c/users/d912359ae10b4799b26248066b6b90fe/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:14.138163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 834/1677] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:14.141636 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68374875-8ff5-4302-aff8-60dd6f382a37 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:14.160157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724a2c-1418-45b2-ad4b-08442b456076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e5bc557f00f448eacf84b9b1652995c, user_id=d912359ae10b4799b26248066b6b90fe, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:14.167201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94724a2c-1418-45b2-ad4b-08442b456076 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:14.168729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68374875-8ff5-4302-aff8-60dd6f382a37 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:14.180176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9671ed-c6a0-4884-a493-ab1b30715215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:14.180875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9671ed-c6a0-4884-a493-ab1b30715215 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:14.181159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9671ed-c6a0-4884-a493-ab1b30715215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:14.181591 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9671ed-c6a0-4884-a493-ab1b30715215 admin admin] PATH_INFO: `/v3/projects/e68eddcbde9841929aec02506ab918d8/users/851ad9185c1644258d21a249c4d9ce69/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:14.199277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9671ed-c6a0-4884-a493-ab1b30715215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68eddcbde9841929aec02506ab918d8, user_id=851ad9185c1644258d21a249c4d9ce69, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:14.205265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9671ed-c6a0-4884-a493-ab1b30715215 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:14.233112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 844/1678] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:13 2022] PUT /identity/v3/projects/3e5bc557f00f448eacf84b9b1652995c/users/d912359ae10b4799b26248066b6b90fe/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:14.244927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 835/1679] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:14 2022] PUT /identity/v3/projects/e68eddcbde9841929aec02506ab918d8/users/851ad9185c1644258d21a249c4d9ce69/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:14.245397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a97f-cd98-4ef3-8308-416d1a7fec41 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:14.245397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a97f-cd98-4ef3-8308-416d1a7fec41 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:14.245811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874a97f-cd98-4ef3-8308-416d1a7fec41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:14.246465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ff44-b841-409c-8a23-b2d0cbbf57cb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:14.246757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ff44-b841-409c-8a23-b2d0cbbf57cb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:14.247035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4ff44-b841-409c-8a23-b2d0cbbf57cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:14.318897 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b7b4ff44-b841-409c-8a23-b2d0cbbf57cb None None] MFA Rules not processed for user `851ad9185c1644258d21a249c4d9ce69`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:14.320480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b7b4ff44-b841-409c-8a23-b2d0cbbf57cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:14.369161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b874a97f-cd98-4ef3-8308-416d1a7fec41 None None] MFA Rules not processed for user `d912359ae10b4799b26248066b6b90fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:14.371940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b874a97f-cd98-4ef3-8308-416d1a7fec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:14.500998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 836/1680] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:14.515136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4ff44-b841-409c-8a23-b2d0cbbf57cb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:14.516900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b7b4ff44-b841-409c-8a23-b2d0cbbf57cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:14.598112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 845/1681] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:14.613820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874a97f-cd98-4ef3-8308-416d1a7fec41 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:14.615364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b874a97f-cd98-4ef3-8308-416d1a7fec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:14.657181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4ff44-b841-409c-8a23-b2d0cbbf57cb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:14.661586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b007c1-c42c-417f-9835-e88183986969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:14.662332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b007c1-c42c-417f-9835-e88183986969 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:14.662593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b007c1-c42c-417f-9835-e88183986969 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:14.662865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b007c1-c42c-417f-9835-e88183986969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:14.676706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b007c1-c42c-417f-9835-e88183986969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:14.678733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b007c1-c42c-417f-9835-e88183986969 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:14.698161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 837/1682] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:14 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:14.781721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b007c1-c42c-417f-9835-e88183986969 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:14.783499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-18b007c1-c42c-417f-9835-e88183986969 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:14.805784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b007c1-c42c-417f-9835-e88183986969 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:14.818510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c69ce8-d1d3-4e55-bec1-271dcde336c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:14.819721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c69ce8-d1d3-4e55-bec1-271dcde336c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:14.824330 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c69ce8-d1d3-4e55-bec1-271dcde336c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:14.824958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c69ce8-d1d3-4e55-bec1-271dcde336c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:14.826947 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874a97f-cd98-4ef3-8308-416d1a7fec41 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:14.840922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa38e2-50f4-429c-910f-3f2e17f83822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:14.841559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa38e2-50f4-429c-910f-3f2e17f83822 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:14.841838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa38e2-50f4-429c-910f-3f2e17f83822 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:14.842133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa38e2-50f4-429c-910f-3f2e17f83822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:14.861724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa38e2-50f4-429c-910f-3f2e17f83822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:14.867789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa38e2-50f4-429c-910f-3f2e17f83822 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:14.877931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:14.890389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 846/1683] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:22:14.890707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:14.906729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c69ce8-d1d3-4e55-bec1-271dcde336c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:14.908392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c69ce8-d1d3-4e55-bec1-271dcde336c2 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:14.937979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 838/1684] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:22:15.155656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073df98-c661-4eac-ba1e-0193fc0014d0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:15.156139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073df98-c661-4eac-ba1e-0193fc0014d0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:15.156376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073df98-c661-4eac-ba1e-0193fc0014d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:15.235308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c073df98-c661-4eac-ba1e-0193fc0014d0 None None] MFA Rules not processed for user `336b111f4b854a21ad3d9fe8fcff6f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:15.236720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c073df98-c661-4eac-ba1e-0193fc0014d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:15.428346 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 847/1685] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:15.439332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfbada-e86e-4206-adaa-1ced6399dbf6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:15.440213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfbada-e86e-4206-adaa-1ced6399dbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:15.440503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfbada-e86e-4206-adaa-1ced6399dbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:15.498412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073df98-c661-4eac-ba1e-0193fc0014d0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:15.506536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c1bfbada-e86e-4206-adaa-1ced6399dbf6 None None] MFA Rules not processed for user `336b111f4b854a21ad3d9fe8fcff6f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:15.511975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c1bfbada-e86e-4206-adaa-1ced6399dbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:15.526873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 839/1686] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:15.551238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41fa03-9a50-4700-969b-ab4bd964b8a2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:15.551925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41fa03-9a50-4700-969b-ab4bd964b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:15.556912 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41fa03-9a50-4700-969b-ab4bd964b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:15.585522 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0b41fa03-9a50-4700-969b-ab4bd964b8a2 None None] MFA Rules not processed for user `a684c639db1f44488d1b05ee55014c71`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:15.587695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0b41fa03-9a50-4700-969b-ab4bd964b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:15.604832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073df98-c661-4eac-ba1e-0193fc0014d0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:15.618170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59902-7ed2-459f-a1b7-dd37c089d260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:15.618777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59902-7ed2-459f-a1b7-dd37c089d260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:15.619048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59902-7ed2-459f-a1b7-dd37c089d260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:15.619312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59902-7ed2-459f-a1b7-dd37c089d260 admin admin] PATH_INFO: `/v3/users/d912359ae10b4799b26248066b6b90fe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:15.622000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a59902-7ed2-459f-a1b7-dd37c089d260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d912359ae10b4799b26248066b6b90fe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:15.627196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a59902-7ed2-459f-a1b7-dd37c089d260 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:15.688274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 840/1687] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:15.689998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41fa03-9a50-4700-969b-ab4bd964b8a2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:15.691789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0b41fa03-9a50-4700-969b-ab4bd964b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:15.716558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41fa03-9a50-4700-969b-ab4bd964b8a2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:15.732515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-52a59902-7ed2-459f-a1b7-dd37c089d260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd912359ae10b4799b26248066b6b90fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:15.733045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc92524-6c8e-49a2-a5fd-c9f2e2de3a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:15.733947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc92524-6c8e-49a2-a5fd-c9f2e2de3a9d service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:15.734436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc92524-6c8e-49a2-a5fd-c9f2e2de3a9d service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:15.734847 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc92524-6c8e-49a2-a5fd-c9f2e2de3a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:15.753879 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc92524-6c8e-49a2-a5fd-c9f2e2de3a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:15.755820 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc92524-6c8e-49a2-a5fd-c9f2e2de3a9d service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:15.766168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-52a59902-7ed2-459f-a1b7-dd37c089d260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd912359ae10b4799b26248066b6b90fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:15.776618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 841/1688] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:15 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:15.801460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-52a59902-7ed2-459f-a1b7-dd37c089d260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd912359ae10b4799b26248066b6b90fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:15.831495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-52a59902-7ed2-459f-a1b7-dd37c089d260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd912359ae10b4799b26248066b6b90fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:15.834180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-52a59902-7ed2-459f-a1b7-dd37c089d260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd912359ae10b4799b26248066b6b90fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:15.843846 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 848/1689] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:15 2022] DELETE /identity/v3/users/d912359ae10b4799b26248066b6b90fe => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:22:15.848780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d57d9-5bb3-46bd-b0b4-1e79f3e8bbe8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:15.849317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d57d9-5bb3-46bd-b0b4-1e79f3e8bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:15.849587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d57d9-5bb3-46bd-b0b4-1e79f3e8bbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:15.892695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4e2d57d9-5bb3-46bd-b0b4-1e79f3e8bbe8 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:15.894217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4e2d57d9-5bb3-46bd-b0b4-1e79f3e8bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:15.988195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad58de4-955a-4020-802c-ed08efc4eb7f None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:15.988837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad58de4-955a-4020-802c-ed08efc4eb7f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:15.989314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad58de4-955a-4020-802c-ed08efc4eb7f None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:15.990896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 849/1690] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:22:16.013373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e5aef-9f3c-433f-8230-2025ce1a0dc3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:16.013823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e5aef-9f3c-433f-8230-2025ce1a0dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:16.013915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e5aef-9f3c-433f-8230-2025ce1a0dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:16.072185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-874e5aef-9f3c-433f-8230-2025ce1a0dc3 None None] MFA Rules not processed for user `2862a661174142d69bbdd54ee0289681`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:16.073461 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-874e5aef-9f3c-433f-8230-2025ce1a0dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:16.082856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 842/1691] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:16.086233 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:16.126561 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d57d9-5bb3-46bd-b0b4-1e79f3e8bbe8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:16.128010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4e2d57d9-5bb3-46bd-b0b4-1e79f3e8bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:16.226966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 850/1692] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:22:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:16.251779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d57d9-5bb3-46bd-b0b4-1e79f3e8bbe8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:16.257237 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3078e-cecf-417c-89c8-d12ccfa4d2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:16.258478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3078e-cecf-417c-89c8-d12ccfa4d2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:16.258840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3078e-cecf-417c-89c8-d12ccfa4d2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:16.259183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3078e-cecf-417c-89c8-d12ccfa4d2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:16.276465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3078e-cecf-417c-89c8-d12ccfa4d2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:16.278182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3078e-cecf-417c-89c8-d12ccfa4d2b4 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:16.310436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 843/1693] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:22:16.343860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df84a67-3538-464c-a9f8-105b7a9b8b10 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:16.344573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df84a67-3538-464c-a9f8-105b7a9b8b10 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:16.345615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df84a67-3538-464c-a9f8-105b7a9b8b10 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:16.349984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 851/1694] 10.222.0.20 () {54 vars in 961 bytes} [Fri Aug 19 15:22:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:22:16.359782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae826e-f33d-4b8e-a369-24c3ecaac22b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:16.360684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae826e-f33d-4b8e-a369-24c3ecaac22b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:16.361384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae826e-f33d-4b8e-a369-24c3ecaac22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:16.419366 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0bae826e-f33d-4b8e-a369-24c3ecaac22b None None] MFA Rules not processed for user `2862a661174142d69bbdd54ee0289681`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:16.427759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0bae826e-f33d-4b8e-a369-24c3ecaac22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:16.456526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 844/1695] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Aug 19 15:22:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:16.465674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df84a67-3538-464c-a9f8-105b7a9b8b10 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:16.508026 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df84a67-3538-464c-a9f8-105b7a9b8b10 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:16.526061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeaac4b-3625-46f8-986a-7042ba21535c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2862a661174142d69bbdd54ee0289681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:16.528316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaac4b-3625-46f8-986a-7042ba21535c service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:16.529514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaac4b-3625-46f8-986a-7042ba21535c service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:16.530205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeaac4b-3625-46f8-986a-7042ba21535c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:16.559448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeaac4b-3625-46f8-986a-7042ba21535c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:16.561764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeaac4b-3625-46f8-986a-7042ba21535c service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:16.602592 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 852/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:16.854551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9fc7e-4698-4d1d-a144-0d28114da875 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:16.854830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9fc7e-4698-4d1d-a144-0d28114da875 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:16.855100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9fc7e-4698-4d1d-a144-0d28114da875 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:16.856717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 845/1697] 10.222.0.20 () {54 vars in 912 bytes} [Fri Aug 19 15:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:22:16.866234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e79f35-db27-47e5-a7ec-aecd095e4a71 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:16.866541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e79f35-db27-47e5-a7ec-aecd095e4a71 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:16.866785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e79f35-db27-47e5-a7ec-aecd095e4a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:16.979242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-59e79f35-db27-47e5-a7ec-aecd095e4a71 None None] MFA Rules not processed for user `a220cf4fafe84d6498bc959a9cd18df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:16.980470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-59e79f35-db27-47e5-a7ec-aecd095e4a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:17.016032 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 853/1698] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:22:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:17.100925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9fc7e-4698-4d1d-a144-0d28114da875 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:17.103064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7af9fc7e-4698-4d1d-a144-0d28114da875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:17.124536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a9463-8b54-40c5-9ad4-c84fa3de3cf7 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:17.124833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a9463-8b54-40c5-9ad4-c84fa3de3cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:17.125118 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a9463-8b54-40c5-9ad4-c84fa3de3cf7 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:17.126634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 854/1699] 10.222.0.20 () {54 vars in 912 bytes} [Fri Aug 19 15:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:22:17.142771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9fc7e-4698-4d1d-a144-0d28114da875 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:17.145589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94be45a-9590-4847-a04b-9e92d3bf9865 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:17.145877 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94be45a-9590-4847-a04b-9e92d3bf9865 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:17.146212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94be45a-9590-4847-a04b-9e92d3bf9865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:17.168988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd8ce-621b-42c7-b957-7c07bd35fd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:17.169622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd8ce-621b-42c7-b957-7c07bd35fd0e service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:17.169903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd8ce-621b-42c7-b957-7c07bd35fd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:17.170812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cedd8ce-621b-42c7-b957-7c07bd35fd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:17.187334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:17.191918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e94be45a-9590-4847-a04b-9e92d3bf9865 None None] MFA Rules not processed for user `a220cf4fafe84d6498bc959a9cd18df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:17.193324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e94be45a-9590-4847-a04b-9e92d3bf9865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:17.196559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedd8ce-621b-42c7-b957-7c07bd35fd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:17.197771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cedd8ce-621b-42c7-b957-7c07bd35fd0e service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:17.224390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 846/1700] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:17.225349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd8ce-621b-42c7-b957-7c07bd35fd0e service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:17.228310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 855/1701] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:22:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:22:17.231331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5cedd8ce-621b-42c7-b957-7c07bd35fd0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:17.256080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94be45a-9590-4847-a04b-9e92d3bf9865 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:17.265882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94be45a-9590-4847-a04b-9e92d3bf9865 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:17.268195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cedd8ce-621b-42c7-b957-7c07bd35fd0e service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:17.276021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffaf2e-9afe-4aff-a91e-ae8775cb558b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:17.276664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffaf2e-9afe-4aff-a91e-ae8775cb558b service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:17.276948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffaf2e-9afe-4aff-a91e-ae8775cb558b service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:17.277227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffaf2e-9afe-4aff-a91e-ae8775cb558b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:17.282630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:17.283500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:17.284214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:17.284744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] PATH_INFO: `/v3/projects/3e5bc557f00f448eacf84b9b1652995c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:17.286131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e5bc557f00f448eacf84b9b1652995c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:17.287359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: WARNING py.warnings [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 15:22:17.287359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: warnings.warn(msg) Aug 19 15:22:17.287359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: Aug 19 15:22:17.289429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:17.294841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffaf2e-9afe-4aff-a91e-ae8775cb558b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:17.296417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffaf2e-9afe-4aff-a91e-ae8775cb558b service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:17.321480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 856/1702] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:22:17.477333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e5bc557f00f448eacf84b9b1652995c', 'request_id': 'req-ad3fd560-a764-4a5b-9fff-754ffdff00d0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:17.494365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e5bc557f00f448eacf84b9b1652995c', 'request_id': 'req-ad3fd560-a764-4a5b-9fff-754ffdff00d0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:17.519508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e5bc557f00f448eacf84b9b1652995c', 'request_id': 'req-ad3fd560-a764-4a5b-9fff-754ffdff00d0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:17.559772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] The token cache is being invalidate because project 3e5bc557f00f448eacf84b9b1652995c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:17.560257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:17.562400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ad3fd560-a764-4a5b-9fff-754ffdff00d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:17.583524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761ea30-58ba-4659-934c-6c0cdadd447e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:17.583795 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761ea30-58ba-4659-934c-6c0cdadd447e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:17.584011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761ea30-58ba-4659-934c-6c0cdadd447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:17.586696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 847/1703] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:17 2022] DELETE /identity/v3/projects/3e5bc557f00f448eacf84b9b1652995c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:17.611703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5761ea30-58ba-4659-934c-6c0cdadd447e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:17.613216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5761ea30-58ba-4659-934c-6c0cdadd447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:17.858503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63cc2c-81b5-430b-b64e-60bcbd77dabb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:17.859129 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63cc2c-81b5-430b-b64e-60bcbd77dabb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:17.859129 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63cc2c-81b5-430b-b64e-60bcbd77dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:17.864629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 857/1704] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:17.927515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1e63cc2c-81b5-430b-b64e-60bcbd77dabb None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:17.935718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1e63cc2c-81b5-430b-b64e-60bcbd77dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:17.956926 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761ea30-58ba-4659-934c-6c0cdadd447e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:17.961852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 848/1705] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:17.971684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761ea30-58ba-4659-934c-6c0cdadd447e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:17.983272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7773e-1389-41ce-986e-10a8ec3986b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:17.985002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7773e-1389-41ce-986e-10a8ec3986b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:17.985286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7773e-1389-41ce-986e-10a8ec3986b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:17.985606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7773e-1389-41ce-986e-10a8ec3986b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:17.986368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7773e-1389-41ce-986e-10a8ec3986b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:22:17.986619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7773e-1389-41ce-986e-10a8ec3986b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:17.988384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7773e-1389-41ce-986e-10a8ec3986b9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:18.030191 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 858/1706] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:22:18.031410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63cc2c-81b5-430b-b64e-60bcbd77dabb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:18.041822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63cc2c-81b5-430b-b64e-60bcbd77dabb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:18.057231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234bdee-d133-4a7b-a77d-0802a709f306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:18.058284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234bdee-d133-4a7b-a77d-0802a709f306 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:18.058780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234bdee-d133-4a7b-a77d-0802a709f306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:18.059243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234bdee-d133-4a7b-a77d-0802a709f306 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:18.060064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234bdee-d133-4a7b-a77d-0802a709f306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:18.065596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234bdee-d133-4a7b-a77d-0802a709f306 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:18.143998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 849/1707] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:18 2022] POST /identity/v3/projects => generated 357 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:18.144196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7773e-1389-41ce-986e-10a8ec3986b9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:18.159152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7773e-1389-41ce-986e-10a8ec3986b9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:18.335545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:18.424503 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b577d-130e-4b95-adab-3cf91b27bc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:18.425142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b577d-130e-4b95-adab-3cf91b27bc4b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:18.425419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b577d-130e-4b95-adab-3cf91b27bc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:18.425695 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b577d-130e-4b95-adab-3cf91b27bc4b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:18.426355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b577d-130e-4b95-adab-3cf91b27bc4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:18.428316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b577d-130e-4b95-adab-3cf91b27bc4b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:18.469883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 859/1708] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:18 2022] POST /identity/v3/users => generated 279 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:18.475755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234bdee-d133-4a7b-a77d-0802a709f306 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:18.485038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b577d-130e-4b95-adab-3cf91b27bc4b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:18.488280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-151b577d-130e-4b95-adab-3cf91b27bc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:18.511093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234bdee-d133-4a7b-a77d-0802a709f306 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:18.521632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b40eb-d034-449f-b520-85ae0ee64c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:18.523773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b40eb-d034-449f-b520-85ae0ee64c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:18.530625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b40eb-d034-449f-b520-85ae0ee64c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:18.531124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b40eb-d034-449f-b520-85ae0ee64c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:18.532425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b40eb-d034-449f-b520-85ae0ee64c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:18.534611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b40eb-d034-449f-b520-85ae0ee64c0c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:18.585304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 850/1709] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:18.586747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b40eb-d034-449f-b520-85ae0ee64c0c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:18.590860 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-191b40eb-d034-449f-b520-85ae0ee64c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:18.759920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b577d-130e-4b95-adab-3cf91b27bc4b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:18.790824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e093e8-80aa-4fd9-9b75-5f71cb4f4e70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2862a661174142d69bbdd54ee0289681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:18.791468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e093e8-80aa-4fd9-9b75-5f71cb4f4e70 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:18.791860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e093e8-80aa-4fd9-9b75-5f71cb4f4e70 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:18.792029 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e093e8-80aa-4fd9-9b75-5f71cb4f4e70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:18.802972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-13e093e8-80aa-4fd9-9b75-5f71cb4f4e70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:18.853141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e093e8-80aa-4fd9-9b75-5f71cb4f4e70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:18.854809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e093e8-80aa-4fd9-9b75-5f71cb4f4e70 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:18.859809 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b40eb-d034-449f-b520-85ae0ee64c0c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:18.883633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 860/1710] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:18.883777 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e8fc-a852-45c5-b649-333dfe221271 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2862a661174142d69bbdd54ee0289681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:18.884321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e8fc-a852-45c5-b649-333dfe221271 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:18.884467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e093e8-80aa-4fd9-9b75-5f71cb4f4e70 service placement] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:18.884607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e8fc-a852-45c5-b649-333dfe221271 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:18.885407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e8fc-a852-45c5-b649-333dfe221271 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:18.910379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e093e8-80aa-4fd9-9b75-5f71cb4f4e70 service placement] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:18.915454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796e8fc-a852-45c5-b649-333dfe221271 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:18.918915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796e8fc-a852-45c5-b649-333dfe221271 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:18.924299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e718dd-3d0d-48cc-9092-d2cb282b26de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:18.924937 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e718dd-3d0d-48cc-9092-d2cb282b26de admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:18.925208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e718dd-3d0d-48cc-9092-d2cb282b26de admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:18.925477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e718dd-3d0d-48cc-9092-d2cb282b26de admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:18.926186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e718dd-3d0d-48cc-9092-d2cb282b26de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:18.927791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e718dd-3d0d-48cc-9092-d2cb282b26de admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:18.952834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 861/1711] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:18.960778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63417f7-21e7-4d6f-a0a4-02b08083d41a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:18.961146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63417f7-21e7-4d6f-a0a4-02b08083d41a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:18.961474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63417f7-21e7-4d6f-a0a4-02b08083d41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:18.974835 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 851/1712] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:18.980377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e8fc-a852-45c5-b649-333dfe221271 service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:19.039300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e8fc-a852-45c5-b649-333dfe221271 service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:19.059057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895a970-1a3e-4f29-8030-79e57b88f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:19.059844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a970-1a3e-4f29-8030-79e57b88f036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:19.062376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a970-1a3e-4f29-8030-79e57b88f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:19.062650 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b63417f7-21e7-4d6f-a0a4-02b08083d41a None None] MFA Rules not processed for user `336b111f4b854a21ad3d9fe8fcff6f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:19.063979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a970-1a3e-4f29-8030-79e57b88f036 admin admin] PATH_INFO: `/v3/projects/84ae2151f71d435097c85cfc3c1370e8/users/d5589c7322c64bc59b6acf237e68ce90/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:19.067244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b63417f7-21e7-4d6f-a0a4-02b08083d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:19.118786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895a970-1a3e-4f29-8030-79e57b88f036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ae2151f71d435097c85cfc3c1370e8, user_id=d5589c7322c64bc59b6acf237e68ce90, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:19.121576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895a970-1a3e-4f29-8030-79e57b88f036 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:19.160170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 852/1713] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:18 2022] PUT /identity/v3/projects/84ae2151f71d435097c85cfc3c1370e8/users/d5589c7322c64bc59b6acf237e68ce90/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:19.170451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bd893-2707-4ecf-b140-29539b28ac37 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:19.170983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bd893-2707-4ecf-b140-29539b28ac37 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:19.171481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bd893-2707-4ecf-b140-29539b28ac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:19.186997 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:19.222130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5c9bd893-2707-4ecf-b140-29539b28ac37 None None] MFA Rules not processed for user `d5589c7322c64bc59b6acf237e68ce90`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:19.223661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5c9bd893-2707-4ecf-b140-29539b28ac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:19.277968 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 862/1714] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:19.392403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 853/1715] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:19.397262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63417f7-21e7-4d6f-a0a4-02b08083d41a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:19.418263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63417f7-21e7-4d6f-a0a4-02b08083d41a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:19.539752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:19.568107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00186840-e107-42ec-9c3e-c2a4727476dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:19.570214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00186840-e107-42ec-9c3e-c2a4727476dd admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:19.570214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00186840-e107-42ec-9c3e-c2a4727476dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:19.570214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00186840-e107-42ec-9c3e-c2a4727476dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:19.580121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00186840-e107-42ec-9c3e-c2a4727476dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:19.580121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00186840-e107-42ec-9c3e-c2a4727476dd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:19.683946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bd893-2707-4ecf-b140-29539b28ac37 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:19.684513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 863/1716] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:19 2022] POST /identity/v3/projects => generated 357 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:19.712331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bd893-2707-4ecf-b140-29539b28ac37 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:19.820388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00186840-e107-42ec-9c3e-c2a4727476dd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:19.823031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-00186840-e107-42ec-9c3e-c2a4727476dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:19.883938 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf317c-dc99-4023-9ab4-f4e5c69e3c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:19.884696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf317c-dc99-4023-9ab4-f4e5c69e3c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:19.884981 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf317c-dc99-4023-9ab4-f4e5c69e3c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:19.885257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf317c-dc99-4023-9ab4-f4e5c69e3c02 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:19.887170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf317c-dc99-4023-9ab4-f4e5c69e3c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:19.893787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf317c-dc99-4023-9ab4-f4e5c69e3c02 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:19.926234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 854/1717] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:19 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:22:19.930479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf317c-dc99-4023-9ab4-f4e5c69e3c02 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:19.958818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf317c-dc99-4023-9ab4-f4e5c69e3c02 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:19.978635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fbe33-7f16-445c-88b1-13514bface5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:19.982840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fbe33-7f16-445c-88b1-13514bface5c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:19.983510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fbe33-7f16-445c-88b1-13514bface5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:19.984477 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fbe33-7f16-445c-88b1-13514bface5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:19.985733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fbe33-7f16-445c-88b1-13514bface5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:19.993340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fbe33-7f16-445c-88b1-13514bface5c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:20.028190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 855/1718] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:20.033189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fbe33-7f16-445c-88b1-13514bface5c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:20.062612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fbe33-7f16-445c-88b1-13514bface5c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:20.077930 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf079-7ee6-4f68-9d6e-9c21adb23ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:20.078812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf079-7ee6-4f68-9d6e-9c21adb23ef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:20.082003 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf079-7ee6-4f68-9d6e-9c21adb23ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:20.082593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf079-7ee6-4f68-9d6e-9c21adb23ef2 admin admin] PATH_INFO: `/v3/projects/82beae2441b547d4857fcf5049b32c94/users/b317a8356a554b35b11a6a0135c899fe/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:20.086254 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00186840-e107-42ec-9c3e-c2a4727476dd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:20.107885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:20.108568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:20.108856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:20.109136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] PATH_INFO: `/v3/users/4cc851578b1348b5bd41b611d53642e2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:20.110352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc851578b1348b5bd41b611d53642e2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:20.113762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:20.178663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf079-7ee6-4f68-9d6e-9c21adb23ef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82beae2441b547d4857fcf5049b32c94, user_id=b317a8356a554b35b11a6a0135c899fe, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:20.213014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf079-7ee6-4f68-9d6e-9c21adb23ef2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:20.326728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 856/1719] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:20 2022] PUT /identity/v3/projects/82beae2441b547d4857fcf5049b32c94/users/b317a8356a554b35b11a6a0135c899fe/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:20.339922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9da964-3d86-4d86-a4b6-acdd253bfeec None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:20.339922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9da964-3d86-4d86-a4b6-acdd253bfeec None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:20.340198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9da964-3d86-4d86-a4b6-acdd253bfeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:20.343026 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc851578b1348b5bd41b611d53642e2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:20.361122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc851578b1348b5bd41b611d53642e2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:20.404365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc851578b1348b5bd41b611d53642e2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:20.432194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc851578b1348b5bd41b611d53642e2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:20.432894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc851578b1348b5bd41b611d53642e2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:20.437026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6d9da964-3d86-4d86-a4b6-acdd253bfeec None None] MFA Rules not processed for user `957c3a73b4f14927905fde65c9c844cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:20.440387 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6d9da964-3d86-4d86-a4b6-acdd253bfeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:20.456699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 864/1720] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:19 2022] DELETE /identity/v3/users/4cc851578b1348b5bd41b611d53642e2 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:20.457730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:20.465145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:20.557753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:20.608443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:20.614473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9262c3-aa3b-43e0-adfe-b7a747ed903b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:20.619282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 857/1721] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:20.646764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d066-3fe9-4d2c-b35a-3ec67ab8578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:20.647944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9da964-3d86-4d86-a4b6-acdd253bfeec None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:20.650186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d066-3fe9-4d2c-b35a-3ec67ab8578c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:20.650568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6d9da964-3d86-4d86-a4b6-acdd253bfeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:20.653102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d066-3fe9-4d2c-b35a-3ec67ab8578c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:20.655282 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d066-3fe9-4d2c-b35a-3ec67ab8578c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:20.660154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6d066-3fe9-4d2c-b35a-3ec67ab8578c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:20.669743 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6d066-3fe9-4d2c-b35a-3ec67ab8578c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:20.722543 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 865/1722] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:20.726408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d066-3fe9-4d2c-b35a-3ec67ab8578c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:20.728994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f7b6d066-3fe9-4d2c-b35a-3ec67ab8578c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:20.797260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d066-3fe9-4d2c-b35a-3ec67ab8578c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:20.822134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:20.823264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:20.824835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:20.825297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] PATH_INFO: `/v3/users/cf9c3cb2823f468eafd20bc5bf08d788` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:20.828660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf9c3cb2823f468eafd20bc5bf08d788)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:20.834397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:20.887086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9da964-3d86-4d86-a4b6-acdd253bfeec None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:20.968637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf9c3cb2823f468eafd20bc5bf08d788'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:20.987216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf9c3cb2823f468eafd20bc5bf08d788'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:21.073345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf9c3cb2823f468eafd20bc5bf08d788'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:21.099966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf9c3cb2823f468eafd20bc5bf08d788'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:21.100635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf9c3cb2823f468eafd20bc5bf08d788'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:21.125432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 866/1723] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:20 2022] DELETE /identity/v3/users/cf9c3cb2823f468eafd20bc5bf08d788 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:21.129502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:21.134993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:21.188177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfea4ec-b76f-48c7-beb3-1ea3db107853 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:21.188972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfea4ec-b76f-48c7-beb3-1ea3db107853 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:21.197729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfea4ec-b76f-48c7-beb3-1ea3db107853 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:21.203368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfea4ec-b76f-48c7-beb3-1ea3db107853 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:21.205640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4cfea4ec-b76f-48c7-beb3-1ea3db107853 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:21.426727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfea4ec-b76f-48c7-beb3-1ea3db107853 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:21.430542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfea4ec-b76f-48c7-beb3-1ea3db107853 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:21.437622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e00078-40d1-4147-94f9-63ae54f2459e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:21.451220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba159795-b2ea-4fae-b04c-db3a7c9de3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:21.452956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba159795-b2ea-4fae-b04c-db3a7c9de3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:21.453724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba159795-b2ea-4fae-b04c-db3a7c9de3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:21.455285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba159795-b2ea-4fae-b04c-db3a7c9de3d8 admin admin] PATH_INFO: `/v3/projects/82beae2441b547d4857fcf5049b32c94/users/b317a8356a554b35b11a6a0135c899fe/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:21.460501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba159795-b2ea-4fae-b04c-db3a7c9de3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82beae2441b547d4857fcf5049b32c94, user_id=b317a8356a554b35b11a6a0135c899fe, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:21.468492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba159795-b2ea-4fae-b04c-db3a7c9de3d8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:21.478622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 858/1724] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:21.480262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17580b1c-2751-41df-a1f9-171cc784298f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:21.482477 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17580b1c-2751-41df-a1f9-171cc784298f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:21.482939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17580b1c-2751-41df-a1f9-171cc784298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:21.509179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 867/1725] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:21 2022] PUT /identity/v3/projects/82beae2441b547d4857fcf5049b32c94/users/b317a8356a554b35b11a6a0135c899fe/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:21.512969 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380355-55f6-401b-b676-1f0afc3bf565 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:21.513349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380355-55f6-401b-b676-1f0afc3bf565 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:21.514326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8380355-55f6-401b-b676-1f0afc3bf565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:21.571986 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-17580b1c-2751-41df-a1f9-171cc784298f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:21.573383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-17580b1c-2751-41df-a1f9-171cc784298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:21.590078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:21.618089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e8380355-55f6-401b-b676-1f0afc3bf565 None None] MFA Rules not processed for user `b317a8356a554b35b11a6a0135c899fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:21.619451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e8380355-55f6-401b-b676-1f0afc3bf565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:21.738685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:21.790573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 859/1726] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:21.792264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17580b1c-2751-41df-a1f9-171cc784298f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:21.794084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 868/1727] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:21.799832 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-17580b1c-2751-41df-a1f9-171cc784298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:21.807051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8380355-55f6-401b-b676-1f0afc3bf565 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:21.808445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e8380355-55f6-401b-b676-1f0afc3bf565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:21.847001 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17580b1c-2751-41df-a1f9-171cc784298f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:21.864851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:21.867189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:21.867189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:21.867481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] PATH_INFO: `/v3/projects/0644f2b040084d2fb59af93bc1068d46` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:21.880068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0644f2b040084d2fb59af93bc1068d46)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:21.881614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:21.982568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8380355-55f6-401b-b676-1f0afc3bf565 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:21.997769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062442-89b4-481b-90dc-0edb0aa1a5a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:21.998475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062442-89b4-481b-90dc-0edb0aa1a5a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:21.998759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062442-89b4-481b-90dc-0edb0aa1a5a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:21.999033 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062442-89b4-481b-90dc-0edb0aa1a5a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:22.019808 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6062442-89b4-481b-90dc-0edb0aa1a5a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:22.021363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6062442-89b4-481b-90dc-0edb0aa1a5a7 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:22.041594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 869/1728] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:22:22.042636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062442-89b4-481b-90dc-0edb0aa1a5a7 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:22.043983 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a6062442-89b4-481b-90dc-0edb0aa1a5a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:22.103760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0644f2b040084d2fb59af93bc1068d46', 'request_id': 'req-80d8d636-1b5a-45fe-8a34-998311bd8664'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:22.127385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0644f2b040084d2fb59af93bc1068d46', 'request_id': 'req-80d8d636-1b5a-45fe-8a34-998311bd8664'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:22.156754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0644f2b040084d2fb59af93bc1068d46', 'request_id': 'req-80d8d636-1b5a-45fe-8a34-998311bd8664'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:22.208557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] The token cache is being invalidate because project 0644f2b040084d2fb59af93bc1068d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:22.209158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:22.211607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:22.222416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 860/1729] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:21 2022] DELETE /identity/v3/projects/0644f2b040084d2fb59af93bc1068d46 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:22.226085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:22.227831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:22.230961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062442-89b4-481b-90dc-0edb0aa1a5a7 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:22.380910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19674531-1d18-4430-9cd3-fa6cb910b85f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:22.381546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19674531-1d18-4430-9cd3-fa6cb910b85f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:22.381827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19674531-1d18-4430-9cd3-fa6cb910b85f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:22.382127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19674531-1d18-4430-9cd3-fa6cb910b85f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:22.383982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-19674531-1d18-4430-9cd3-fa6cb910b85f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:22.412324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8d636-1b5a-45fe-8a34-998311bd8664 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:22.413774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19674531-1d18-4430-9cd3-fa6cb910b85f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:22.415485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19674531-1d18-4430-9cd3-fa6cb910b85f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:22.435903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 870/1730] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:22.436988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19674531-1d18-4430-9cd3-fa6cb910b85f service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:22.443129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-19674531-1d18-4430-9cd3-fa6cb910b85f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:22.453851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:22.456623 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:22.457199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:22.458409 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] PATH_INFO: `/v3/users/2d1a3b97b8824e318b285a1880b38b3c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:22.460513 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1a3b97b8824e318b285a1880b38b3c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:22.464557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:22.571879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:22.578430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19674531-1d18-4430-9cd3-fa6cb910b85f service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:22.586238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73592ef1-89a4-49bb-995b-30edf7ae76c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:22.587377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73592ef1-89a4-49bb-995b-30edf7ae76c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:22.587988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73592ef1-89a4-49bb-995b-30edf7ae76c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:22.588485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73592ef1-89a4-49bb-995b-30edf7ae76c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:22.591850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-73592ef1-89a4-49bb-995b-30edf7ae76c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:22.627086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:22.679937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1a3b97b8824e318b285a1880b38b3c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:22.684113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1a3b97b8824e318b285a1880b38b3c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:22.685385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1a3b97b8824e318b285a1880b38b3c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:22.692290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73592ef1-89a4-49bb-995b-30edf7ae76c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:22.695965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73592ef1-89a4-49bb-995b-30edf7ae76c4 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:22.707731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 871/1731] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:22.738882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1a3b97b8824e318b285a1880b38b3c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:22.764709 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1a3b97b8824e318b285a1880b38b3c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:22.859318 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 861/1732] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:22 2022] DELETE /identity/v3/users/2d1a3b97b8824e318b285a1880b38b3c => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:23.717193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef24b12-b03a-423a-80e3-72928c9fa72f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:23.717751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef24b12-b03a-423a-80e3-72928c9fa72f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:23.717751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef24b12-b03a-423a-80e3-72928c9fa72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:23.831714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cef24b12-b03a-423a-80e3-72928c9fa72f None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:23.833008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cef24b12-b03a-423a-80e3-72928c9fa72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:24.024306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 872/1733] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:22:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:24.254352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:24.255415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:24.337118 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef24b12-b03a-423a-80e3-72928c9fa72f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:24.338895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cef24b12-b03a-423a-80e3-72928c9fa72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:24.476378 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba6e4d-f710-4ed2-8859-71ed093e57f8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:24.490005 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:24.491085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:24.492463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:24.493275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] PATH_INFO: `/v3/projects/8b565dfd504c4d8d8300d272d0c55ec4` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:24.496828 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b565dfd504c4d8d8300d272d0c55ec4)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:24.509643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:24.572872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:24.600481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef24b12-b03a-423a-80e3-72928c9fa72f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:24.612820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22da0e4-22f8-48f2-a272-78f386d99bb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:24.613543 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da0e4-22f8-48f2-a272-78f386d99bb4 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:24.613828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da0e4-22f8-48f2-a272-78f386d99bb4 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:24.615413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22da0e4-22f8-48f2-a272-78f386d99bb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:24.638495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22da0e4-22f8-48f2-a272-78f386d99bb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:24.640117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22da0e4-22f8-48f2-a272-78f386d99bb4 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:24.657684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 873/1734] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:22:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 15:22:24.659044 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232f6e9-9c1b-4798-8609-8489d15130e0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:24.659318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232f6e9-9c1b-4798-8609-8489d15130e0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:24.659871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232f6e9-9c1b-4798-8609-8489d15130e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:24.731538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3232f6e9-9c1b-4798-8609-8489d15130e0 None None] MFA Rules not processed for user `9546b7c51b1747ff8d6f5faca3857b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:24.734486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3232f6e9-9c1b-4798-8609-8489d15130e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:24.785295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b565dfd504c4d8d8300d272d0c55ec4', 'request_id': 'req-6464f56c-8278-4bb2-be90-943d20a31a47'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:24.800991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b565dfd504c4d8d8300d272d0c55ec4', 'request_id': 'req-6464f56c-8278-4bb2-be90-943d20a31a47'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:24.834457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b565dfd504c4d8d8300d272d0c55ec4', 'request_id': 'req-6464f56c-8278-4bb2-be90-943d20a31a47'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:24.853976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] The token cache is being invalidate because project 8b565dfd504c4d8d8300d272d0c55ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:24.854305 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:24.855579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6464f56c-8278-4bb2-be90-943d20a31a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:24.861538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 862/1735] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:24 2022] DELETE /identity/v3/projects/8b565dfd504c4d8d8300d272d0c55ec4 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:24.864206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106aaa4-7d06-4e2d-ab37-52078a3ce50f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:24.864499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106aaa4-7d06-4e2d-ab37-52078a3ce50f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:24.866004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106aaa4-7d06-4e2d-ab37-52078a3ce50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:24.902056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9106aaa4-7d06-4e2d-ab37-52078a3ce50f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:24.903268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9106aaa4-7d06-4e2d-ab37-52078a3ce50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:24.971966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:24.991273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 874/1736] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:24.992789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063acff2-9e80-4e10-b87d-7a36ae6d167b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:24.993063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063acff2-9e80-4e10-b87d-7a36ae6d167b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:24.993334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063acff2-9e80-4e10-b87d-7a36ae6d167b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:25.003768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 863/1737] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:25.012952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4f8d2-24aa-44c8-acff-7336c1de19f2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:25.013251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4f8d2-24aa-44c8-acff-7336c1de19f2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:25.013511 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4f8d2-24aa-44c8-acff-7336c1de19f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:25.046425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-063acff2-9e80-4e10-b87d-7a36ae6d167b None None] MFA Rules not processed for user `9546b7c51b1747ff8d6f5faca3857b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:25.049310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-063acff2-9e80-4e10-b87d-7a36ae6d167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:25.097591 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bcb4f8d2-24aa-44c8-acff-7336c1de19f2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:25.110021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bcb4f8d2-24aa-44c8-acff-7336c1de19f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:25.131302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 864/1738] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:25.137940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4f8d2-24aa-44c8-acff-7336c1de19f2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:25.163279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4f8d2-24aa-44c8-acff-7336c1de19f2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:25.169052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90971837-c329-4544-a93c-0a69417385f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:25.169670 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971837-c329-4544-a93c-0a69417385f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:25.169947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971837-c329-4544-a93c-0a69417385f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:25.170243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90971837-c329-4544-a93c-0a69417385f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:25.171091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90971837-c329-4544-a93c-0a69417385f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:22:25.171196 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90971837-c329-4544-a93c-0a69417385f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:25.172793 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90971837-c329-4544-a93c-0a69417385f1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:25.202893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 865/1739] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:22:25.208066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90971837-c329-4544-a93c-0a69417385f1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:25.235469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90971837-c329-4544-a93c-0a69417385f1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:25.256855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430449-09d0-40da-9218-4c1392d736ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:25.257730 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430449-09d0-40da-9218-4c1392d736ba admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:25.257808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430449-09d0-40da-9218-4c1392d736ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:25.258020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430449-09d0-40da-9218-4c1392d736ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:25.266254 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 875/1740] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:25.267221 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc430449-09d0-40da-9218-4c1392d736ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:25.269337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc430449-09d0-40da-9218-4c1392d736ba admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:25.272131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063acff2-9e80-4e10-b87d-7a36ae6d167b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:25.274906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-063acff2-9e80-4e10-b87d-7a36ae6d167b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:25.320125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063acff2-9e80-4e10-b87d-7a36ae6d167b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:25.337216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:25.338481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:25.338788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:25.340468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] PATH_INFO: `/v3/projects/630a7a7ffa274415ac7d1c1fefd5b843` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:25.347586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630a7a7ffa274415ac7d1c1fefd5b843)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:25.352918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 866/1741] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:25 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:22:25.354002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430449-09d0-40da-9218-4c1392d736ba admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:25.357665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fc430449-09d0-40da-9218-4c1392d736ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:25.359046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:25.560999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630a7a7ffa274415ac7d1c1fefd5b843', 'request_id': 'req-c954ba33-3c4b-4d35-8a35-e159bd38acc5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:25.593671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630a7a7ffa274415ac7d1c1fefd5b843', 'request_id': 'req-c954ba33-3c4b-4d35-8a35-e159bd38acc5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:25.609898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630a7a7ffa274415ac7d1c1fefd5b843', 'request_id': 'req-c954ba33-3c4b-4d35-8a35-e159bd38acc5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:25.643871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:25.661061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] The token cache is being invalidate because project 630a7a7ffa274415ac7d1c1fefd5b843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:25.661386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:25.665787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:25.668128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 876/1742] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:25 2022] DELETE /identity/v3/projects/630a7a7ffa274415ac7d1c1fefd5b843 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:25.675094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:25.681107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:25.689232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430449-09d0-40da-9218-4c1392d736ba admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:25.880815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954ba33-3c4b-4d35-8a35-e159bd38acc5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:25.897913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55187e5-bf21-4a28-8685-6c011219b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:25.900328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55187e5-bf21-4a28-8685-6c011219b8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:25.901047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55187e5-bf21-4a28-8685-6c011219b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:25.902069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55187e5-bf21-4a28-8685-6c011219b8c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:25.903639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55187e5-bf21-4a28-8685-6c011219b8c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:25.916789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55187e5-bf21-4a28-8685-6c011219b8c7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:25.929158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12295118-00a8-4d12-8f46-2d3ec97d4df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:25.929801 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12295118-00a8-4d12-8f46-2d3ec97d4df9 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:25.930107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12295118-00a8-4d12-8f46-2d3ec97d4df9 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:25.930389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12295118-00a8-4d12-8f46-2d3ec97d4df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:25.957882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-12295118-00a8-4d12-8f46-2d3ec97d4df9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:25.975348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 877/1743] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:25 2022] POST /identity/v3/users => generated 286 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:25.977707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55187e5-bf21-4a28-8685-6c011219b8c7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:25.984295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d55187e5-bf21-4a28-8685-6c011219b8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:26.017166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55187e5-bf21-4a28-8685-6c011219b8c7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:26.028767 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:26.031252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:26.031742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:26.032244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] PATH_INFO: `/v3/users/851ad9185c1644258d21a249c4d9ce69` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:26.038340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851ad9185c1644258d21a249c4d9ce69)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:26.040733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:26.176482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851ad9185c1644258d21a249c4d9ce69'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:26.209939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:26.216530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851ad9185c1644258d21a249c4d9ce69'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:26.284028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851ad9185c1644258d21a249c4d9ce69'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:26.288917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12295118-00a8-4d12-8f46-2d3ec97d4df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:26.294722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12295118-00a8-4d12-8f46-2d3ec97d4df9 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:26.318125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851ad9185c1644258d21a249c4d9ce69'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:26.322555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851ad9185c1644258d21a249c4d9ce69'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:26.357248 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 878/1744] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:25 2022] DELETE /identity/v3/users/851ad9185c1644258d21a249c4d9ce69 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:26.357439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 867/1745] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 998 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:26.357526 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:26.358819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:26.635232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34d99c-d1fe-4db2-b0a5-6e6888812b97 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:26.657308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891761d1-e87d-4d1f-ade4-98df010def7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:26.658276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891761d1-e87d-4d1f-ade4-98df010def7c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:26.658575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891761d1-e87d-4d1f-ade4-98df010def7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:26.658881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891761d1-e87d-4d1f-ade4-98df010def7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:26.659610 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891761d1-e87d-4d1f-ade4-98df010def7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:26.671637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891761d1-e87d-4d1f-ade4-98df010def7c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:26.690939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:26.722357 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 879/1746] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:26.722930 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12295118-00a8-4d12-8f46-2d3ec97d4df9 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:26.737202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12295118-00a8-4d12-8f46-2d3ec97d4df9 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:26.804611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cef3e-4e95-4d90-89c8-361a5ee3a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:26.805285 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cef3e-4e95-4d90-89c8-361a5ee3a08f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:26.805568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cef3e-4e95-4d90-89c8-361a5ee3a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:26.805835 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cef3e-4e95-4d90-89c8-361a5ee3a08f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:26.806552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cef3e-4e95-4d90-89c8-361a5ee3a08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:26.808185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cef3e-4e95-4d90-89c8-361a5ee3a08f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:26.897694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891761d1-e87d-4d1f-ade4-98df010def7c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:26.898648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 868/1747] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:22:26.909882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891761d1-e87d-4d1f-ade4-98df010def7c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:26.916313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b4841-c9ae-42a6-9a7f-19d6b3dfbf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:26.917607 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b4841-c9ae-42a6-9a7f-19d6b3dfbf96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:26.918215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b4841-c9ae-42a6-9a7f-19d6b3dfbf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:26.919296 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b4841-c9ae-42a6-9a7f-19d6b3dfbf96 admin admin] PATH_INFO: `/v3/projects/0bec5865b5a14836b2110aeed347413a/users/5ecd65d6dc844accacb7a3cccb633233/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:26.941727 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b4841-c9ae-42a6-9a7f-19d6b3dfbf96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bec5865b5a14836b2110aeed347413a, user_id=5ecd65d6dc844accacb7a3cccb633233, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:26.946911 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b4841-c9ae-42a6-9a7f-19d6b3dfbf96 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:27.004505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 880/1748] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:26 2022] PUT /identity/v3/projects/0bec5865b5a14836b2110aeed347413a/users/5ecd65d6dc844accacb7a3cccb633233/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:27.008034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8680d4-eddc-42de-8576-410c6fc7084f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:27.008578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8680d4-eddc-42de-8576-410c6fc7084f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:27.009050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8680d4-eddc-42de-8576-410c6fc7084f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:27.125899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4a8680d4-eddc-42de-8576-410c6fc7084f None None] MFA Rules not processed for user `5ecd65d6dc844accacb7a3cccb633233`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:27.133082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4a8680d4-eddc-42de-8576-410c6fc7084f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:27.412286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b4841-c9ae-42a6-9a7f-19d6b3dfbf96 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:27.428552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 869/1749] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:27.645215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b4841-c9ae-42a6-9a7f-19d6b3dfbf96 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:27.668199 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e46ae-54c9-499d-a0e3-6c371cc3cfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:27.668853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e46ae-54c9-499d-a0e3-6c371cc3cfec admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:27.672147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e46ae-54c9-499d-a0e3-6c371cc3cfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:27.672488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e46ae-54c9-499d-a0e3-6c371cc3cfec admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:27.684525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e46ae-54c9-499d-a0e3-6c371cc3cfec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:27.694313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e46ae-54c9-499d-a0e3-6c371cc3cfec admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:27.808265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 881/1750] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:27 2022] POST /identity/v3/projects => generated 371 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:27.810086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8680d4-eddc-42de-8576-410c6fc7084f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:27.840745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8680d4-eddc-42de-8576-410c6fc7084f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:28.064983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ffb5c-477d-4f2f-a8a2-ae62c2515d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:28.066727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ffb5c-477d-4f2f-a8a2-ae62c2515d0d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:28.071727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ffb5c-477d-4f2f-a8a2-ae62c2515d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:28.072263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ffb5c-477d-4f2f-a8a2-ae62c2515d0d admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:28.073089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ffb5c-477d-4f2f-a8a2-ae62c2515d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:28.085568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ffb5c-477d-4f2f-a8a2-ae62c2515d0d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:28.145436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 870/1751] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:27 2022] POST /identity/v3/users => generated 292 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:28.145858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e46ae-54c9-499d-a0e3-6c371cc3cfec admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:28.168310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e46ae-54c9-499d-a0e3-6c371cc3cfec admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:28.198223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fda3f-6bf8-4dd4-b512-9b10ce6fe0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:28.199059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fda3f-6bf8-4dd4-b512-9b10ce6fe0bb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:28.199434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fda3f-6bf8-4dd4-b512-9b10ce6fe0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:28.199765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fda3f-6bf8-4dd4-b512-9b10ce6fe0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:28.200526 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fda3f-6bf8-4dd4-b512-9b10ce6fe0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:28.202325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fda3f-6bf8-4dd4-b512-9b10ce6fe0bb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:28.269283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 882/1752] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:22:28.271362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ffb5c-477d-4f2f-a8a2-ae62c2515d0d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:28.301510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ffb5c-477d-4f2f-a8a2-ae62c2515d0d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:28.315199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddb753-991b-4690-8b9c-9e168bb13cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:28.317291 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddb753-991b-4690-8b9c-9e168bb13cea admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:28.319118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddb753-991b-4690-8b9c-9e168bb13cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:28.319810 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddb753-991b-4690-8b9c-9e168bb13cea admin admin] PATH_INFO: `/v3/projects/ffc8590acc244d509c5ffdf7cb8d2dbc/users/99f298562411422aac0980152cb716de/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:28.379023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddb753-991b-4690-8b9c-9e168bb13cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc8590acc244d509c5ffdf7cb8d2dbc, user_id=99f298562411422aac0980152cb716de, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:28.390288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddb753-991b-4690-8b9c-9e168bb13cea admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:28.425909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 871/1753] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:28 2022] PUT /identity/v3/projects/ffc8590acc244d509c5ffdf7cb8d2dbc/users/99f298562411422aac0980152cb716de/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:28.426745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fda3f-6bf8-4dd4-b512-9b10ce6fe0bb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:28.471112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fda3f-6bf8-4dd4-b512-9b10ce6fe0bb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:28.731785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4ca42-54e9-4368-8b2d-f3096eefa0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:28.732418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4ca42-54e9-4368-8b2d-f3096eefa0dc admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:28.732701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4ca42-54e9-4368-8b2d-f3096eefa0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:28.732981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4ca42-54e9-4368-8b2d-f3096eefa0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:28.733642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4ca42-54e9-4368-8b2d-f3096eefa0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:28.738505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4ca42-54e9-4368-8b2d-f3096eefa0dc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:28.770502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 883/1754] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:28.773071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddb753-991b-4690-8b9c-9e168bb13cea admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:28.792150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddb753-991b-4690-8b9c-9e168bb13cea admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:28.810754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd089-f9e8-4bfc-81a5-6d53b972ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:28.814003 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd089-f9e8-4bfc-81a5-6d53b972ea34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:28.817575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd089-f9e8-4bfc-81a5-6d53b972ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:28.817575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd089-f9e8-4bfc-81a5-6d53b972ea34 admin admin] PATH_INFO: `/v3/projects/ffc8590acc244d509c5ffdf7cb8d2dbc/users/99f298562411422aac0980152cb716de/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:28.821806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dd089-f9e8-4bfc-81a5-6d53b972ea34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc8590acc244d509c5ffdf7cb8d2dbc, user_id=99f298562411422aac0980152cb716de, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:28.833007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dd089-f9e8-4bfc-81a5-6d53b972ea34 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:28.849387 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 872/1755] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:28 2022] PUT /identity/v3/projects/ffc8590acc244d509c5ffdf7cb8d2dbc/users/99f298562411422aac0980152cb716de/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:28.859901 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df641868-d43e-46b6-be68-c63c1c700fb7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:28.860224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df641868-d43e-46b6-be68-c63c1c700fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:28.861058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df641868-d43e-46b6-be68-c63c1c700fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:28.947172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-df641868-d43e-46b6-be68-c63c1c700fb7 None None] MFA Rules not processed for user `99f298562411422aac0980152cb716de`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:28.948417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-df641868-d43e-46b6-be68-c63c1c700fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:29.082339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:29.193060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 884/1756] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:29.202577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd089-f9e8-4bfc-81a5-6d53b972ea34 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:29.205134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ea1dd089-f9e8-4bfc-81a5-6d53b972ea34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:29.230695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:29.300713 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26f910-60b6-40c9-b6f4-6c4afc1ce3a1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:29.300983 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26f910-60b6-40c9-b6f4-6c4afc1ce3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:29.301566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26f910-60b6-40c9-b6f4-6c4afc1ce3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:29.367648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-db26f910-60b6-40c9-b6f4-6c4afc1ce3a1 None None] MFA Rules not processed for user `a220cf4fafe84d6498bc959a9cd18df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:29.369001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-db26f910-60b6-40c9-b6f4-6c4afc1ce3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:29.414665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd089-f9e8-4bfc-81a5-6d53b972ea34 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:29.427827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b06fdc-98f3-43d0-963a-b654ad8893c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:29.428787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b06fdc-98f3-43d0-963a-b654ad8893c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:29.429623 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b06fdc-98f3-43d0-963a-b654ad8893c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:29.430280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b06fdc-98f3-43d0-963a-b654ad8893c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:29.459263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b06fdc-98f3-43d0-963a-b654ad8893c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:29.461480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b06fdc-98f3-43d0-963a-b654ad8893c5 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:29.512501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 873/1757] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:29.621182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 885/1758] 10.222.0.73 () {58 vars in 1015 bytes} [Fri Aug 19 15:22:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:22:29.729475 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b06fdc-98f3-43d0-963a-b654ad8893c5 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:29.741270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b06fdc-98f3-43d0-963a-b654ad8893c5 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:29.764656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a498336-d313-4c99-9863-60661bf0b31c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:29.765381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a498336-d313-4c99-9863-60661bf0b31c service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:29.765927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a498336-d313-4c99-9863-60661bf0b31c service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:29.767010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a498336-d313-4c99-9863-60661bf0b31c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:29.873113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26f910-60b6-40c9-b6f4-6c4afc1ce3a1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:29.875161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-db26f910-60b6-40c9-b6f4-6c4afc1ce3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:29.891210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26f910-60b6-40c9-b6f4-6c4afc1ce3a1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:29.903207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a85f5-0958-46c5-b5df-49daadda4997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:29.911405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a85f5-0958-46c5-b5df-49daadda4997 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:29.911405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a85f5-0958-46c5-b5df-49daadda4997 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:29.911405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a85f5-0958-46c5-b5df-49daadda4997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:29.918885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a498336-d313-4c99-9863-60661bf0b31c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:29.921475 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a498336-d313-4c99-9863-60661bf0b31c service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:29.922773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a85f5-0958-46c5-b5df-49daadda4997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:29.927406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a85f5-0958-46c5-b5df-49daadda4997 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:29.949512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 874/1759] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:22:29.950280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 886/1760] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:30.842621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f427f6-7e13-4d80-b074-9c91dc1b7b47 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:30.842909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f427f6-7e13-4d80-b074-9c91dc1b7b47 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:30.843190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f427f6-7e13-4d80-b074-9c91dc1b7b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:30.965436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-54f427f6-7e13-4d80-b074-9c91dc1b7b47 None None] MFA Rules not processed for user `c2c4ba36ac1240e0bbca86690a69b64c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:30.966703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-54f427f6-7e13-4d80-b074-9c91dc1b7b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:31.194113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 875/1761] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:31.687447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a85f5-0958-46c5-b5df-49daadda4997 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:31.689088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-198a85f5-0958-46c5-b5df-49daadda4997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:31.923482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a85f5-0958-46c5-b5df-49daadda4997 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:31.957834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205c3f8-7af2-4232-8a7f-812711ac44c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:31.962509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c3f8-7af2-4232-8a7f-812711ac44c9 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:31.962823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c3f8-7af2-4232-8a7f-812711ac44c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:31.965244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c3f8-7af2-4232-8a7f-812711ac44c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:32.012328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205c3f8-7af2-4232-8a7f-812711ac44c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:32.018143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205c3f8-7af2-4232-8a7f-812711ac44c9 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:32.087862 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 887/1762] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:33.003755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f427f6-7e13-4d80-b074-9c91dc1b7b47 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:33.005401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-54f427f6-7e13-4d80-b074-9c91dc1b7b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:33.178208 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:33.271404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f427f6-7e13-4d80-b074-9c91dc1b7b47 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:33.294379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:33.323794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:33.324343 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:33.324737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] PATH_INFO: `/v3/projects/e68eddcbde9841929aec02506ab918d8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:33.328087 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68eddcbde9841929aec02506ab918d8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:33.336274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:33.575702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68eddcbde9841929aec02506ab918d8', 'request_id': 'req-4cc13990-a70a-4809-a90b-9990edfeacd6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:33.588894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68eddcbde9841929aec02506ab918d8', 'request_id': 'req-4cc13990-a70a-4809-a90b-9990edfeacd6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:33.616174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68eddcbde9841929aec02506ab918d8', 'request_id': 'req-4cc13990-a70a-4809-a90b-9990edfeacd6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:33.643526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] The token cache is being invalidate because project e68eddcbde9841929aec02506ab918d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:33.646274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:33.649726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4cc13990-a70a-4809-a90b-9990edfeacd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:33.659434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 876/1763] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:33 2022] DELETE /identity/v3/projects/e68eddcbde9841929aec02506ab918d8 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:33.661351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789282-4f5c-4ac3-87e8-eaf5c34424ef None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:33.661996 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789282-4f5c-4ac3-87e8-eaf5c34424ef None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:33.661996 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789282-4f5c-4ac3-87e8-eaf5c34424ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:33.741601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-10789282-4f5c-4ac3-87e8-eaf5c34424ef None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:33.743326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-10789282-4f5c-4ac3-87e8-eaf5c34424ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:33.981619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:34.018706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 888/1764] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:34.027726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e849159-7f00-44a6-bb88-41103e0ee487 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:34.028741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e849159-7f00-44a6-bb88-41103e0ee487 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:34.029933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e849159-7f00-44a6-bb88-41103e0ee487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:34.127150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6e849159-7f00-44a6-bb88-41103e0ee487 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:34.128915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6e849159-7f00-44a6-bb88-41103e0ee487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:34.141936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 877/1765] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:34.146430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10789282-4f5c-4ac3-87e8-eaf5c34424ef None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:34.163123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10789282-4f5c-4ac3-87e8-eaf5c34424ef None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:34.179048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416164e2-0316-4ea6-97e4-0d5e66366a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:34.180052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416164e2-0316-4ea6-97e4-0d5e66366a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:34.184354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416164e2-0316-4ea6-97e4-0d5e66366a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:34.184765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416164e2-0316-4ea6-97e4-0d5e66366a06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:34.185520 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416164e2-0316-4ea6-97e4-0d5e66366a06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:22:34.188731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416164e2-0316-4ea6-97e4-0d5e66366a06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:34.193718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416164e2-0316-4ea6-97e4-0d5e66366a06 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:34.239452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 889/1766] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:22:34.244130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e849159-7f00-44a6-bb88-41103e0ee487 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:34.270363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e849159-7f00-44a6-bb88-41103e0ee487 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:34.287400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29feb6-076a-455a-aa58-9a9b3ac09022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:34.288184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29feb6-076a-455a-aa58-9a9b3ac09022 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:34.288698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29feb6-076a-455a-aa58-9a9b3ac09022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:34.289208 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29feb6-076a-455a-aa58-9a9b3ac09022 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:34.290076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29feb6-076a-455a-aa58-9a9b3ac09022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:34.292234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29feb6-076a-455a-aa58-9a9b3ac09022 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:34.365262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416164e2-0316-4ea6-97e4-0d5e66366a06 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:34.378258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 878/1767] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:34 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:34.381863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416164e2-0316-4ea6-97e4-0d5e66366a06 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:34.597964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afd121-f470-4c35-923c-d4e956790b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:34.599091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd121-f470-4c35-923c-d4e956790b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:34.599386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd121-f470-4c35-923c-d4e956790b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:34.599899 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afd121-f470-4c35-923c-d4e956790b05 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:34.601010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afd121-f470-4c35-923c-d4e956790b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:34.602457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afd121-f470-4c35-923c-d4e956790b05 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:34.683521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 890/1768] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:34 2022] POST /identity/v3/users => generated 294 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:34.684919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29feb6-076a-455a-aa58-9a9b3ac09022 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:34.704842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29feb6-076a-455a-aa58-9a9b3ac09022 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:34.718748 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd13fb-733d-47ec-9206-fdb797f80a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:34.721251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd13fb-733d-47ec-9206-fdb797f80a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:34.721751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd13fb-733d-47ec-9206-fdb797f80a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:34.722277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd13fb-733d-47ec-9206-fdb797f80a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:34.724982 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd13fb-733d-47ec-9206-fdb797f80a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:34.739999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd13fb-733d-47ec-9206-fdb797f80a82 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:34.804349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 879/1769] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:34.806529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afd121-f470-4c35-923c-d4e956790b05 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:34.819554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8141d-958c-46bb-a53e-1d046a24a417 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:34.824525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8141d-958c-46bb-a53e-1d046a24a417 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:34.826668 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8141d-958c-46bb-a53e-1d046a24a417 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:34.829646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 880/1770] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:22:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:22:34.831389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afd121-f470-4c35-923c-d4e956790b05 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:34.848954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066d5ac-e21a-4ad6-b722-73f9bec2254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:34.851675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066d5ac-e21a-4ad6-b722-73f9bec2254d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:34.853312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066d5ac-e21a-4ad6-b722-73f9bec2254d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:34.854332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066d5ac-e21a-4ad6-b722-73f9bec2254d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:34.856139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066d5ac-e21a-4ad6-b722-73f9bec2254d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:34.858505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066d5ac-e21a-4ad6-b722-73f9bec2254d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:34.872240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145464d3-2dd0-4e0d-86ee-9a2811855488 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:34.872692 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145464d3-2dd0-4e0d-86ee-9a2811855488 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:34.873076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145464d3-2dd0-4e0d-86ee-9a2811855488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:34.928549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 891/1771] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:34.933347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066d5ac-e21a-4ad6-b722-73f9bec2254d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:34.945681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-145464d3-2dd0-4e0d-86ee-9a2811855488 None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:34.953261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-145464d3-2dd0-4e0d-86ee-9a2811855488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:34.962356 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066d5ac-e21a-4ad6-b722-73f9bec2254d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:34.989585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd35ec-406f-42e8-a2ae-8d2db41f1a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:34.990328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd35ec-406f-42e8-a2ae-8d2db41f1a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:34.990614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd35ec-406f-42e8-a2ae-8d2db41f1a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:34.990897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd35ec-406f-42e8-a2ae-8d2db41f1a2e admin admin] PATH_INFO: `/v3/projects/4c5fdc4cdfab49528c0e10a57ee2587f/users/78a3877e6d334137bf2f5346deb1a124/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:35.030373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd35ec-406f-42e8-a2ae-8d2db41f1a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5fdc4cdfab49528c0e10a57ee2587f, user_id=78a3877e6d334137bf2f5346deb1a124, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:35.044394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd35ec-406f-42e8-a2ae-8d2db41f1a2e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:35.105574 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 892/1772] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:34 2022] PUT /identity/v3/projects/4c5fdc4cdfab49528c0e10a57ee2587f/users/78a3877e6d334137bf2f5346deb1a124/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:35.120198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2109b-7564-4a49-8ab0-e84f4fe6015b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:35.120483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2109b-7564-4a49-8ab0-e84f4fe6015b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:35.124702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2109b-7564-4a49-8ab0-e84f4fe6015b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:35.216660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1eb2109b-7564-4a49-8ab0-e84f4fe6015b None None] MFA Rules not processed for user `78a3877e6d334137bf2f5346deb1a124`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:35.218226 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1eb2109b-7564-4a49-8ab0-e84f4fe6015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:35.225532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 881/1773] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:22:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:22:35.447822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 893/1774] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:35.453029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145464d3-2dd0-4e0d-86ee-9a2811855488 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:35.474689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145464d3-2dd0-4e0d-86ee-9a2811855488 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:35.558167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:35.708921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8c9b6-f72d-4759-931f-52edb48a203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:35.709633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c9b6-f72d-4759-931f-52edb48a203c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:35.709837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c9b6-f72d-4759-931f-52edb48a203c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:35.710134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c9b6-f72d-4759-931f-52edb48a203c admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:35.719122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8c9b6-f72d-4759-931f-52edb48a203c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:35.733485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8c9b6-f72d-4759-931f-52edb48a203c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:35.800963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2109b-7564-4a49-8ab0-e84f4fe6015b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:35.803283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1eb2109b-7564-4a49-8ab0-e84f4fe6015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:35.832148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 882/1775] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:35 2022] POST /identity/v3/projects => generated 389 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:35.837757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8c9b6-f72d-4759-931f-52edb48a203c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:35.883812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:36.045683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8c9b6-f72d-4759-931f-52edb48a203c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:36.061331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e183de-ef63-4a9d-904e-94f594b089fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:36.063430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e183de-ef63-4a9d-904e-94f594b089fd admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:36.064122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e183de-ef63-4a9d-904e-94f594b089fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:36.065228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e183de-ef63-4a9d-904e-94f594b089fd admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:36.068253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e183de-ef63-4a9d-904e-94f594b089fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:36.074590 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e183de-ef63-4a9d-904e-94f594b089fd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:36.077721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2109b-7564-4a49-8ab0-e84f4fe6015b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:36.124245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 883/1776] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:35 2022] POST /identity/v3/users => generated 301 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:36.129550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e183de-ef63-4a9d-904e-94f594b089fd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:36.152829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e183de-ef63-4a9d-904e-94f594b089fd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:36.166491 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf252c6b-2962-47a8-8c79-01322216cfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:36.167176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf252c6b-2962-47a8-8c79-01322216cfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:36.167400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf252c6b-2962-47a8-8c79-01322216cfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:36.168724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf252c6b-2962-47a8-8c79-01322216cfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:36.169381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf252c6b-2962-47a8-8c79-01322216cfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:36.183957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf252c6b-2962-47a8-8c79-01322216cfb3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:36.216489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 884/1777] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:36.218432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf252c6b-2962-47a8-8c79-01322216cfb3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:36.249894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf252c6b-2962-47a8-8c79-01322216cfb3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:36.261259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012c00-d74c-41df-8f98-82ac39df8468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:36.262186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012c00-d74c-41df-8f98-82ac39df8468 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:36.262466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012c00-d74c-41df-8f98-82ac39df8468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:36.262908 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d012c00-d74c-41df-8f98-82ac39df8468 admin admin] PATH_INFO: `/v3/projects/c1129b6c676140e0b2e12dfd7970ac7f/users/8fc13dfca7f74297bb3fb6e2ac2457b3/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:36.299200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d012c00-d74c-41df-8f98-82ac39df8468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1129b6c676140e0b2e12dfd7970ac7f, user_id=8fc13dfca7f74297bb3fb6e2ac2457b3, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:36.309469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d012c00-d74c-41df-8f98-82ac39df8468 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:36.310319 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e0b1b-ae29-457d-85d8-68ff9a01665d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:36.312285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e0b1b-ae29-457d-85d8-68ff9a01665d service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:36.312722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e0b1b-ae29-457d-85d8-68ff9a01665d service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:36.313771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e0b1b-ae29-457d-85d8-68ff9a01665d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:36.328330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e0b1b-ae29-457d-85d8-68ff9a01665d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:36.331865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e0b1b-ae29-457d-85d8-68ff9a01665d service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:36.337873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 885/1778] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:36 2022] PUT /identity/v3/projects/c1129b6c676140e0b2e12dfd7970ac7f/users/8fc13dfca7f74297bb3fb6e2ac2457b3/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:36.342225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012c00-d74c-41df-8f98-82ac39df8468 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:36.350977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 894/1779] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:36.511731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d012c00-d74c-41df-8f98-82ac39df8468 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:36.527257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062d8ab-aefb-462a-9290-953c70a42870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:36.528264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062d8ab-aefb-462a-9290-953c70a42870 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:36.528808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062d8ab-aefb-462a-9290-953c70a42870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:36.529222 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062d8ab-aefb-462a-9290-953c70a42870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:36.530920 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062d8ab-aefb-462a-9290-953c70a42870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:36.534728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062d8ab-aefb-462a-9290-953c70a42870 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:36.554332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:36.566588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 886/1780] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:36.568187 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e0b1b-ae29-457d-85d8-68ff9a01665d service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:36.598532 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e0b1b-ae29-457d-85d8-68ff9a01665d service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:36.606832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d4f36-7685-424d-a0d4-bbac3838e521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:36.607548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d4f36-7685-424d-a0d4-bbac3838e521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:36.607853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d4f36-7685-424d-a0d4-bbac3838e521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:36.608654 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d4f36-7685-424d-a0d4-bbac3838e521 admin admin] PATH_INFO: `/v3/projects/c1129b6c676140e0b2e12dfd7970ac7f/users/8fc13dfca7f74297bb3fb6e2ac2457b3/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:36.623424 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d4f36-7685-424d-a0d4-bbac3838e521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1129b6c676140e0b2e12dfd7970ac7f, user_id=8fc13dfca7f74297bb3fb6e2ac2457b3, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:36.627150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d4f36-7685-424d-a0d4-bbac3838e521 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:36.648900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 895/1781] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:36 2022] PUT /identity/v3/projects/c1129b6c676140e0b2e12dfd7970ac7f/users/8fc13dfca7f74297bb3fb6e2ac2457b3/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:36.661818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde41d-eecb-4d91-8d9e-f4cc97faebf6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:36.662333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde41d-eecb-4d91-8d9e-f4cc97faebf6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:36.662620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde41d-eecb-4d91-8d9e-f4cc97faebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:36.727266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-94bde41d-eecb-4d91-8d9e-f4cc97faebf6 None None] MFA Rules not processed for user `8fc13dfca7f74297bb3fb6e2ac2457b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:36.728614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-94bde41d-eecb-4d91-8d9e-f4cc97faebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:36.736200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14468059-aeef-4dc7-8af6-124aa34cde67 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:36.736810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14468059-aeef-4dc7-8af6-124aa34cde67 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:36.736953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14468059-aeef-4dc7-8af6-124aa34cde67 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:36.738348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 896/1782] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:22:36.831707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728892d3-1730-43da-8da9-29663d5d2126 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:36.832373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728892d3-1730-43da-8da9-29663d5d2126 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:36.832373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728892d3-1730-43da-8da9-29663d5d2126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:36.862351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-728892d3-1730-43da-8da9-29663d5d2126 None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:36.864049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-728892d3-1730-43da-8da9-29663d5d2126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:36.967972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 887/1783] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:37.002452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bde41d-eecb-4d91-8d9e-f4cc97faebf6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:37.003954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-94bde41d-eecb-4d91-8d9e-f4cc97faebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:37.136413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 897/1784] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:22:37.204509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bde41d-eecb-4d91-8d9e-f4cc97faebf6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:37.216902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a493f-de29-4864-b989-983d69cd94fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:37.221810 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a493f-de29-4864-b989-983d69cd94fc service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:37.223329 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a493f-de29-4864-b989-983d69cd94fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:37.223620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a493f-de29-4864-b989-983d69cd94fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:37.273740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a493f-de29-4864-b989-983d69cd94fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:37.277978 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a493f-de29-4864-b989-983d69cd94fc service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:37.353095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 888/1785] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:37 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:37.788367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728892d3-1730-43da-8da9-29663d5d2126 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:37.789956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-728892d3-1730-43da-8da9-29663d5d2126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:37.824698 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728892d3-1730-43da-8da9-29663d5d2126 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:37.840149 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672181a3-d15a-41f7-8fdf-e626f3949fbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:37.840851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672181a3-d15a-41f7-8fdf-e626f3949fbf service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:37.841049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672181a3-d15a-41f7-8fdf-e626f3949fbf service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:37.841525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672181a3-d15a-41f7-8fdf-e626f3949fbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:37.862127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672181a3-d15a-41f7-8fdf-e626f3949fbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:37.864809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672181a3-d15a-41f7-8fdf-e626f3949fbf service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:37.888590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 898/1786] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:38.053354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ebeb0-0d82-41d1-baef-35f22d854d76 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:38.053905 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ebeb0-0d82-41d1-baef-35f22d854d76 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:38.054346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ebeb0-0d82-41d1-baef-35f22d854d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:38.148275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8f6ebeb0-0d82-41d1-baef-35f22d854d76 None None] MFA Rules not processed for user `957c3a73b4f14927905fde65c9c844cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:38.149766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8f6ebeb0-0d82-41d1-baef-35f22d854d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:38.418155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 889/1787] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:38.425264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672181a3-d15a-41f7-8fdf-e626f3949fbf service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:38.451003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:38.731031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672181a3-d15a-41f7-8fdf-e626f3949fbf service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:38.756003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:38.756782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:38.761144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:38.761409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] PATH_INFO: `/v3/users/78a3877e6d334137bf2f5346deb1a124` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:38.767762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a3877e6d334137bf2f5346deb1a124)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:38.773865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:39.048617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a3877e6d334137bf2f5346deb1a124'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:39.089465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a3877e6d334137bf2f5346deb1a124'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:39.125336 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a3877e6d334137bf2f5346deb1a124'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:39.152031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a3877e6d334137bf2f5346deb1a124'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:39.154776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a3877e6d334137bf2f5346deb1a124'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:39.180436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 899/1788] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:38 2022] DELETE /identity/v3/users/78a3877e6d334137bf2f5346deb1a124 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:39.187238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aaf5c-fb74-43b0-a47a-c8d740eb5eb3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:39.190573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aaf5c-fb74-43b0-a47a-c8d740eb5eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:39.192165 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aaf5c-fb74-43b0-a47a-c8d740eb5eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:39.292903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-a44aaf5c-fb74-43b0-a47a-c8d740eb5eb3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:39.294179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a44aaf5c-fb74-43b0-a47a-c8d740eb5eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:39.407973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:39.490479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 890/1789] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:39.520076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:39.521711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:39.740740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8f4b6-3bfa-4a54-a85f-39d8dac3550f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:39.756088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c842f9-52eb-4e90-a71a-28311c53da99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:39.756826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c842f9-52eb-4e90-a71a-28311c53da99 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:39.757128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c842f9-52eb-4e90-a71a-28311c53da99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:39.757470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c842f9-52eb-4e90-a71a-28311c53da99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:39.818957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c842f9-52eb-4e90-a71a-28311c53da99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:39.820552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c842f9-52eb-4e90-a71a-28311c53da99 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:39.837383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 900/1790] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:41.184058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44aaf5c-fb74-43b0-a47a-c8d740eb5eb3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:41.187178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a44aaf5c-fb74-43b0-a47a-c8d740eb5eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:41.214853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44aaf5c-fb74-43b0-a47a-c8d740eb5eb3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:41.225515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:41.226551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:41.226997 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:41.227557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] PATH_INFO: `/v3/projects/4c5fdc4cdfab49528c0e10a57ee2587f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:41.229357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5fdc4cdfab49528c0e10a57ee2587f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:41.239012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:41.382490 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5fdc4cdfab49528c0e10a57ee2587f', 'request_id': 'req-1b522279-06a7-4d9d-b054-206f62b12899'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:41.393523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5fdc4cdfab49528c0e10a57ee2587f', 'request_id': 'req-1b522279-06a7-4d9d-b054-206f62b12899'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:41.410867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5fdc4cdfab49528c0e10a57ee2587f', 'request_id': 'req-1b522279-06a7-4d9d-b054-206f62b12899'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:41.429140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] The token cache is being invalidate because project 4c5fdc4cdfab49528c0e10a57ee2587f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:41.431742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:41.433819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1b522279-06a7-4d9d-b054-206f62b12899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:41.439528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 891/1791] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:41 2022] DELETE /identity/v3/projects/4c5fdc4cdfab49528c0e10a57ee2587f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:41.443567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c842f9-52eb-4e90-a71a-28311c53da99 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:41.465335 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c842f9-52eb-4e90-a71a-28311c53da99 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:41.544864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:41.601893 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:41.604013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:41.604532 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:41.604958 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] PATH_INFO: `/v3/users/8fc13dfca7f74297bb3fb6e2ac2457b3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:41.606507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc13dfca7f74297bb3fb6e2ac2457b3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:41.609828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:41.706975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc13dfca7f74297bb3fb6e2ac2457b3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:41.744743 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc13dfca7f74297bb3fb6e2ac2457b3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:41.785107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc13dfca7f74297bb3fb6e2ac2457b3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:41.805205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc13dfca7f74297bb3fb6e2ac2457b3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:41.806088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc13dfca7f74297bb3fb6e2ac2457b3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:41.826387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 901/1792] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:41 2022] DELETE /identity/v3/users/8fc13dfca7f74297bb3fb6e2ac2457b3 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:42.197701 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06f89-2a40-4885-a7b5-36a889b2aa6b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:42.198808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06f89-2a40-4885-a7b5-36a889b2aa6b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:42.199493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06f89-2a40-4885-a7b5-36a889b2aa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:42.236580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:42.238388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:42.243307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d3d06f89-2a40-4885-a7b5-36a889b2aa6b None None] MFA Rules not processed for user `c2c4ba36ac1240e0bbca86690a69b64c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:42.248647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d3d06f89-2a40-4885-a7b5-36a889b2aa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:42.348442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 892/1793] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:42.364512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ef2ec-3d62-4811-b31c-382119de5fef admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:42.371925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:42.372584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:42.372942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:42.373336 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] PATH_INFO: `/v3/projects/c1129b6c676140e0b2e12dfd7970ac7f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:42.374375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1129b6c676140e0b2e12dfd7970ac7f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:42.377028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:42.449337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1129b6c676140e0b2e12dfd7970ac7f', 'request_id': 'req-d7f5f44e-f806-4786-8159-f6bdfa45d913'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:42.453189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:42.456318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1129b6c676140e0b2e12dfd7970ac7f', 'request_id': 'req-d7f5f44e-f806-4786-8159-f6bdfa45d913'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:42.465197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1129b6c676140e0b2e12dfd7970ac7f', 'request_id': 'req-d7f5f44e-f806-4786-8159-f6bdfa45d913'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:42.477719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] The token cache is being invalidate because project c1129b6c676140e0b2e12dfd7970ac7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:42.478179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:42.478935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7f5f44e-f806-4786-8159-f6bdfa45d913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:42.480565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 902/1794] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:42 2022] DELETE /identity/v3/projects/c1129b6c676140e0b2e12dfd7970ac7f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:42.486150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162910e-7b22-44ba-9fc7-3852a50e8f13 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:42.486663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162910e-7b22-44ba-9fc7-3852a50e8f13 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:42.486945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162910e-7b22-44ba-9fc7-3852a50e8f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:42.506806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9162910e-7b22-44ba-9fc7-3852a50e8f13 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:42.508015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9162910e-7b22-44ba-9fc7-3852a50e8f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:42.576259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 893/1795] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:42.584506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f8ca1-6b9a-4dda-b20a-b87de0339d41 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:42.584793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f8ca1-6b9a-4dda-b20a-b87de0339d41 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:42.585068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f8ca1-6b9a-4dda-b20a-b87de0339d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:42.605922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-767f8ca1-6b9a-4dda-b20a-b87de0339d41 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:42.607234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-767f8ca1-6b9a-4dda-b20a-b87de0339d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:42.615936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 903/1796] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:42.620308 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162910e-7b22-44ba-9fc7-3852a50e8f13 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:42.625236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:42.632808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162910e-7b22-44ba-9fc7-3852a50e8f13 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:42.638972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c14c61-1471-4404-af49-ef87d732b421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:42.639733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c14c61-1471-4404-af49-ef87d732b421 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:42.640126 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c14c61-1471-4404-af49-ef87d732b421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:42.640497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c14c61-1471-4404-af49-ef87d732b421 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:42.641307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c14c61-1471-4404-af49-ef87d732b421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:22:42.641615 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c14c61-1471-4404-af49-ef87d732b421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:42.643284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c14c61-1471-4404-af49-ef87d732b421 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:42.656072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 894/1797] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:22:42.660651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f8ca1-6b9a-4dda-b20a-b87de0339d41 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:42.670734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f8ca1-6b9a-4dda-b20a-b87de0339d41 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:42.677458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b7326-2a10-44d6-847f-90a8f6704128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:42.678129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b7326-2a10-44d6-847f-90a8f6704128 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:42.678403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b7326-2a10-44d6-847f-90a8f6704128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:42.678684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b7326-2a10-44d6-847f-90a8f6704128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:42.679339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b7326-2a10-44d6-847f-90a8f6704128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:42.681248 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b7326-2a10-44d6-847f-90a8f6704128 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:42.715956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 904/1798] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:42 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:42.717422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c14c61-1471-4404-af49-ef87d732b421 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:42.729307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c14c61-1471-4404-af49-ef87d732b421 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:42.793572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439abd51-a85e-4bdf-8906-af62b9bd01ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:42.794232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439abd51-a85e-4bdf-8906-af62b9bd01ec admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:42.794516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439abd51-a85e-4bdf-8906-af62b9bd01ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:42.794789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439abd51-a85e-4bdf-8906-af62b9bd01ec admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:42.795442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439abd51-a85e-4bdf-8906-af62b9bd01ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:42.797381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439abd51-a85e-4bdf-8906-af62b9bd01ec admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:42.831750 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 895/1799] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:42 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:42.835602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b7326-2a10-44d6-847f-90a8f6704128 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:42.859301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b7326-2a10-44d6-847f-90a8f6704128 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:42.872379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398c397-e141-483d-a43d-d549b6fcddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:42.873469 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c397-e141-483d-a43d-d549b6fcddfd admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:42.874007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c397-e141-483d-a43d-d549b6fcddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:42.874545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c397-e141-483d-a43d-d549b6fcddfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:42.875999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398c397-e141-483d-a43d-d549b6fcddfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:42.878151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398c397-e141-483d-a43d-d549b6fcddfd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:42.893495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 905/1800] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:42.896011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439abd51-a85e-4bdf-8906-af62b9bd01ec admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:42.910318 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439abd51-a85e-4bdf-8906-af62b9bd01ec admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:42.919276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5565c-b758-42aa-a9f4-57b61f92ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:42.935328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5565c-b758-42aa-a9f4-57b61f92ba07 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:42.935328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5565c-b758-42aa-a9f4-57b61f92ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:42.935328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5565c-b758-42aa-a9f4-57b61f92ba07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:42.935328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5565c-b758-42aa-a9f4-57b61f92ba07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:42.935328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5565c-b758-42aa-a9f4-57b61f92ba07 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:42.939774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 896/1801] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:42.944364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398c397-e141-483d-a43d-d549b6fcddfd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:42.957687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398c397-e141-483d-a43d-d549b6fcddfd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:42.964625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1358f-3f0c-4fa5-bb66-85f2caecda2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:42.965308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1358f-3f0c-4fa5-bb66-85f2caecda2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:42.965586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1358f-3f0c-4fa5-bb66-85f2caecda2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:42.966572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1358f-3f0c-4fa5-bb66-85f2caecda2e admin admin] PATH_INFO: `/v3/projects/d397f439d7f6488eab0bc0f8f29a1664/users/2fb553c5747c4878ad4545b4beaaf6cb/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:42.993062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1358f-3f0c-4fa5-bb66-85f2caecda2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d397f439d7f6488eab0bc0f8f29a1664, user_id=2fb553c5747c4878ad4545b4beaaf6cb, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:42.996096 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1358f-3f0c-4fa5-bb66-85f2caecda2e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:43.020139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 906/1802] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:42 2022] PUT /identity/v3/projects/d397f439d7f6488eab0bc0f8f29a1664/users/2fb553c5747c4878ad4545b4beaaf6cb/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:43.031397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beecd32-8e48-4b92-917c-1484e0087bff None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:43.032303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beecd32-8e48-4b92-917c-1484e0087bff None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:43.032682 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beecd32-8e48-4b92-917c-1484e0087bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:43.080042 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7beecd32-8e48-4b92-917c-1484e0087bff None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:43.081556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7beecd32-8e48-4b92-917c-1484e0087bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:43.221107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 897/1803] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:43.289112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1358f-3f0c-4fa5-bb66-85f2caecda2e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:43.291186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-29f1358f-3f0c-4fa5-bb66-85f2caecda2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:43.474873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1358f-3f0c-4fa5-bb66-85f2caecda2e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:43.482974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f349831-9951-4732-892b-ab71698db148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:43.484617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f349831-9951-4732-892b-ab71698db148 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:43.484832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f349831-9951-4732-892b-ab71698db148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:43.486588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f349831-9951-4732-892b-ab71698db148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:43.534975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f349831-9951-4732-892b-ab71698db148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:43.537555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f349831-9951-4732-892b-ab71698db148 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:43.562936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 907/1804] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:45.511177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beecd32-8e48-4b92-917c-1484e0087bff None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:45.513034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7beecd32-8e48-4b92-917c-1484e0087bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:45.542019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beecd32-8e48-4b92-917c-1484e0087bff None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:45.557607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:45.559833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:45.560326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:45.560817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] PATH_INFO: `/v3/users/d5589c7322c64bc59b6acf237e68ce90` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:45.565513 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5589c7322c64bc59b6acf237e68ce90)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:45.571838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:45.685939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5589c7322c64bc59b6acf237e68ce90'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:45.687045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5589c7322c64bc59b6acf237e68ce90'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:45.687811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5589c7322c64bc59b6acf237e68ce90'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:45.701695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5589c7322c64bc59b6acf237e68ce90'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:45.711815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5589c7322c64bc59b6acf237e68ce90'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:45.713499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:45.744169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 898/1805] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:45 2022] DELETE /identity/v3/users/d5589c7322c64bc59b6acf237e68ce90 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:45.745504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fa64f-4b6f-466a-9e6e-d4ea88adb035 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:45.745978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fa64f-4b6f-466a-9e6e-d4ea88adb035 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:45.746213 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fa64f-4b6f-466a-9e6e-d4ea88adb035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:45.778376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-588fa64f-4b6f-466a-9e6e-d4ea88adb035 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:45.779597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-588fa64f-4b6f-466a-9e6e-d4ea88adb035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:45.900681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 908/1806] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:45.977563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:45.979486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:46.070247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c89ed2-6e36-4e45-895f-a7bb11e6a639 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:46.071001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c89ed2-6e36-4e45-895f-a7bb11e6a639 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:46.071428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c89ed2-6e36-4e45-895f-a7bb11e6a639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:46.109483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b672c5-40f9-4521-b5ea-7e0f0dafd6da admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:46.113944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af420c59-baca-448f-8de2-4c10e046260d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:46.114846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420c59-baca-448f-8de2-4c10e046260d service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:46.115307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420c59-baca-448f-8de2-4c10e046260d service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:46.115785 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af420c59-baca-448f-8de2-4c10e046260d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:46.130794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af420c59-baca-448f-8de2-4c10e046260d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:46.133041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af420c59-baca-448f-8de2-4c10e046260d service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:46.133453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-23c89ed2-6e36-4e45-895f-a7bb11e6a639 None None] MFA Rules not processed for user `2fb553c5747c4878ad4545b4beaaf6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:46.135406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-23c89ed2-6e36-4e45-895f-a7bb11e6a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:46.146975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 899/1807] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:46.151816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:46.230302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 909/1808] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:46.235242 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af420c59-baca-448f-8de2-4c10e046260d service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:46.236954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-af420c59-baca-448f-8de2-4c10e046260d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:46.253961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af420c59-baca-448f-8de2-4c10e046260d service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:46.261444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90824d-7fe2-48fa-92c0-5e40cff59bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:46.262453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90824d-7fe2-48fa-92c0-5e40cff59bbd admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:46.262999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90824d-7fe2-48fa-92c0-5e40cff59bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:46.263450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90824d-7fe2-48fa-92c0-5e40cff59bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:46.264447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90824d-7fe2-48fa-92c0-5e40cff59bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:46.267334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90824d-7fe2-48fa-92c0-5e40cff59bbd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:46.312432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 900/1809] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:46 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:46.317377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c89ed2-6e36-4e45-895f-a7bb11e6a639 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:46.338795 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c89ed2-6e36-4e45-895f-a7bb11e6a639 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:46.420189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c7203-dec4-4298-a163-7123ab0b762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:46.421479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c7203-dec4-4298-a163-7123ab0b762d admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:46.421967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c7203-dec4-4298-a163-7123ab0b762d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:46.422527 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c7203-dec4-4298-a163-7123ab0b762d admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:46.425363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c7203-dec4-4298-a163-7123ab0b762d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:46.427816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c7203-dec4-4298-a163-7123ab0b762d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:46.470659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90824d-7fe2-48fa-92c0-5e40cff59bbd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:46.479042 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 910/1810] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:46 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:46.490182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90824d-7fe2-48fa-92c0-5e40cff59bbd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:46.500243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ea659-f218-483f-afb4-00499e22ff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:46.501895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea659-f218-483f-afb4-00499e22ff5a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:46.502648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea659-f218-483f-afb4-00499e22ff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:46.502884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea659-f218-483f-afb4-00499e22ff5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:46.503795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ea659-f218-483f-afb4-00499e22ff5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:46.506207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ea659-f218-483f-afb4-00499e22ff5a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:46.526931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c7203-dec4-4298-a163-7123ab0b762d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:46.527662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 901/1811] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:46.545099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c7203-dec4-4298-a163-7123ab0b762d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:46.595078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff7d1-7b3d-4b5c-b64e-49ebd330a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:46.597600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff7d1-7b3d-4b5c-b64e-49ebd330a62d admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:46.599060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff7d1-7b3d-4b5c-b64e-49ebd330a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:46.599563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff7d1-7b3d-4b5c-b64e-49ebd330a62d admin admin] PATH_INFO: `/v3/projects/38556783e5284bc2afa5e11db73ad5f9/users/717e02bd761d4116a2b2c40a90c73847/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:46.671675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ff7d1-7b3d-4b5c-b64e-49ebd330a62d admin admin] RBAC: Authorizing `identity:create_grant(project_id=38556783e5284bc2afa5e11db73ad5f9, user_id=717e02bd761d4116a2b2c40a90c73847, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:46.682928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ff7d1-7b3d-4b5c-b64e-49ebd330a62d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:46.716935 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ea659-f218-483f-afb4-00499e22ff5a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:46.717966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 911/1812] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:46 2022] PUT /identity/v3/projects/38556783e5284bc2afa5e11db73ad5f9/users/717e02bd761d4116a2b2c40a90c73847/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:46.733768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ea659-f218-483f-afb4-00499e22ff5a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:46.829762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009daf41-b8f9-40ec-951b-54b33a8a7e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:46.831087 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009daf41-b8f9-40ec-951b-54b33a8a7e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:46.831837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009daf41-b8f9-40ec-951b-54b33a8a7e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:46.832513 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009daf41-b8f9-40ec-951b-54b33a8a7e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:46.834091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009daf41-b8f9-40ec-951b-54b33a8a7e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:46.840859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009daf41-b8f9-40ec-951b-54b33a8a7e19 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:46.858805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff7d1-7b3d-4b5c-b64e-49ebd330a62d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:46.860390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 902/1813] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:46.872401 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff7d1-7b3d-4b5c-b64e-49ebd330a62d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:46.879563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06663281-8210-4e87-bc40-e39e9805fa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:46.880684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06663281-8210-4e87-bc40-e39e9805fa1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:46.881317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06663281-8210-4e87-bc40-e39e9805fa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:46.881807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06663281-8210-4e87-bc40-e39e9805fa1b admin admin] PATH_INFO: `/v3/projects/38556783e5284bc2afa5e11db73ad5f9/users/717e02bd761d4116a2b2c40a90c73847/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:46.885338 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06663281-8210-4e87-bc40-e39e9805fa1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38556783e5284bc2afa5e11db73ad5f9, user_id=717e02bd761d4116a2b2c40a90c73847, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:46.889524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06663281-8210-4e87-bc40-e39e9805fa1b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:46.906331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 912/1814] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:46 2022] PUT /identity/v3/projects/38556783e5284bc2afa5e11db73ad5f9/users/717e02bd761d4116a2b2c40a90c73847/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:22:47.634235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009daf41-b8f9-40ec-951b-54b33a8a7e19 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:47.635991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-009daf41-b8f9-40ec-951b-54b33a8a7e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:47.668877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009daf41-b8f9-40ec-951b-54b33a8a7e19 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:47.741989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:47.772249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:47.772898 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:47.773178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:47.773452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] PATH_INFO: `/v3/projects/84ae2151f71d435097c85cfc3c1370e8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:47.776376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ae2151f71d435097c85cfc3c1370e8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:47.778357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:47.910374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ae2151f71d435097c85cfc3c1370e8', 'request_id': 'req-941d45f6-e604-4344-9d2c-c19beca882a7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:47.941302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ae2151f71d435097c85cfc3c1370e8', 'request_id': 'req-941d45f6-e604-4344-9d2c-c19beca882a7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:47.958606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ae2151f71d435097c85cfc3c1370e8', 'request_id': 'req-941d45f6-e604-4344-9d2c-c19beca882a7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:47.978184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] The token cache is being invalidate because project 84ae2151f71d435097c85cfc3c1370e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:47.978987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:47.979961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:47.983004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 903/1815] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:47 2022] DELETE /identity/v3/projects/84ae2151f71d435097c85cfc3c1370e8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:47.989950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06663281-8210-4e87-bc40-e39e9805fa1b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:47.993803 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-06663281-8210-4e87-bc40-e39e9805fa1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:48.015184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06663281-8210-4e87-bc40-e39e9805fa1b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:48.108785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8fbfb-140a-4ac1-992d-5296052fe4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:48.109458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8fbfb-140a-4ac1-992d-5296052fe4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:48.109745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8fbfb-140a-4ac1-992d-5296052fe4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:48.110075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8fbfb-140a-4ac1-992d-5296052fe4f3 admin admin] PATH_INFO: `/v3/users/b317a8356a554b35b11a6a0135c899fe` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:48.111492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8fbfb-140a-4ac1-992d-5296052fe4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b317a8356a554b35b11a6a0135c899fe)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:48.114141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8fbfb-140a-4ac1-992d-5296052fe4f3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:48.123261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:48.198248 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-86b8fbfb-140a-4ac1-992d-5296052fe4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b317a8356a554b35b11a6a0135c899fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:48.209789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-86b8fbfb-140a-4ac1-992d-5296052fe4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b317a8356a554b35b11a6a0135c899fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:48.234343 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-86b8fbfb-140a-4ac1-992d-5296052fe4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b317a8356a554b35b11a6a0135c899fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:48.246274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-86b8fbfb-140a-4ac1-992d-5296052fe4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b317a8356a554b35b11a6a0135c899fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:48.247192 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-86b8fbfb-140a-4ac1-992d-5296052fe4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b317a8356a554b35b11a6a0135c899fe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:48.262210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 913/1816] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:22:47 2022] DELETE /identity/v3/users/b317a8356a554b35b11a6a0135c899fe => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:48.664463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:48.680058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d45f6-e604-4344-9d2c-c19beca882a7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:48.758177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:48.758931 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:48.759278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:48.759637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] PATH_INFO: `/v3/projects/82beae2441b547d4857fcf5049b32c94` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:48.761023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=82beae2441b547d4857fcf5049b32c94)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:48.763062 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:48.827721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82beae2441b547d4857fcf5049b32c94', 'request_id': 'req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:48.835655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82beae2441b547d4857fcf5049b32c94', 'request_id': 'req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:48.844122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82beae2441b547d4857fcf5049b32c94', 'request_id': 'req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:48.858495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] The token cache is being invalidate because project 82beae2441b547d4857fcf5049b32c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:22:48.859143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:48.860548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3d467e5-77b8-4a87-81fe-98b66dcd3d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:22:48.862332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 904/1817] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:22:48 2022] DELETE /identity/v3/projects/82beae2441b547d4857fcf5049b32c94 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:48.867424 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480c3a-9548-408b-8c2c-b1eca8d96eb7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:48.867713 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480c3a-9548-408b-8c2c-b1eca8d96eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:48.867992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86480c3a-9548-408b-8c2c-b1eca8d96eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:48.889033 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-86480c3a-9548-408b-8c2c-b1eca8d96eb7 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:48.890209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-86480c3a-9548-408b-8c2c-b1eca8d96eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:48.963016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 914/1818] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:48.971549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e21d8b-7e6a-4cdc-aa68-95b7f5d2dc12 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:48.971963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e21d8b-7e6a-4cdc-aa68-95b7f5d2dc12 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:48.972309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e21d8b-7e6a-4cdc-aa68-95b7f5d2dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:48.989066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:48.995484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b1e21d8b-7e6a-4cdc-aa68-95b7f5d2dc12 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:48.997311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b1e21d8b-7e6a-4cdc-aa68-95b7f5d2dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:49.005383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 905/1819] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:49.009882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86480c3a-9548-408b-8c2c-b1eca8d96eb7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:49.021113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86480c3a-9548-408b-8c2c-b1eca8d96eb7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:49.026689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe071e-990a-483d-a8b5-8a2c4b0d2e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:49.027359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe071e-990a-483d-a8b5-8a2c4b0d2e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:49.027715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe071e-990a-483d-a8b5-8a2c4b0d2e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:49.028078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe071e-990a-483d-a8b5-8a2c4b0d2e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:49.028804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe071e-990a-483d-a8b5-8a2c4b0d2e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:22:49.029174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe071e-990a-483d-a8b5-8a2c4b0d2e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:49.031020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe071e-990a-483d-a8b5-8a2c4b0d2e16 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:49.048961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 915/1820] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:22:49.053111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e21d8b-7e6a-4cdc-aa68-95b7f5d2dc12 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:49.065771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e21d8b-7e6a-4cdc-aa68-95b7f5d2dc12 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:49.073585 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2362991-b2f9-4b83-9e9d-d5175d0cbd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:49.074456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362991-b2f9-4b83-9e9d-d5175d0cbd1f admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:49.074566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362991-b2f9-4b83-9e9d-d5175d0cbd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:49.074789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362991-b2f9-4b83-9e9d-d5175d0cbd1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:49.075747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362991-b2f9-4b83-9e9d-d5175d0cbd1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:49.077658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362991-b2f9-4b83-9e9d-d5175d0cbd1f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:49.131006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 906/1821] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:49 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:49.132509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe071e-990a-483d-a8b5-8a2c4b0d2e16 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:49.155616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe071e-990a-483d-a8b5-8a2c4b0d2e16 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:49.233063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac3e4b-8d25-4aa1-b6c9-e7631a49b1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:49.233766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac3e4b-8d25-4aa1-b6c9-e7631a49b1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:49.234265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac3e4b-8d25-4aa1-b6c9-e7631a49b1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:49.234608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac3e4b-8d25-4aa1-b6c9-e7631a49b1e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:49.235476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac3e4b-8d25-4aa1-b6c9-e7631a49b1e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:49.237520 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac3e4b-8d25-4aa1-b6c9-e7631a49b1e7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:49.257985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:49.269116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 916/1822] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:49 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:49.271394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2362991-b2f9-4b83-9e9d-d5175d0cbd1f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:49.302188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2362991-b2f9-4b83-9e9d-d5175d0cbd1f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:49.309523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b2ab-ca34-4322-b2ec-2d82a6e1ef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:49.313289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b2ab-ca34-4322-b2ec-2d82a6e1ef73 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:49.313575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b2ab-ca34-4322-b2ec-2d82a6e1ef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:49.313851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4b2ab-ca34-4322-b2ec-2d82a6e1ef73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:49.316376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b2ab-ca34-4322-b2ec-2d82a6e1ef73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:49.318052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4b2ab-ca34-4322-b2ec-2d82a6e1ef73 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:49.331228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 907/1823] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:49.335284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac3e4b-8d25-4aa1-b6c9-e7631a49b1e7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:49.350416 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac3e4b-8d25-4aa1-b6c9-e7631a49b1e7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:49.364868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fa85d-bd27-45de-91c0-202a289b1254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:49.365762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa85d-bd27-45de-91c0-202a289b1254 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:49.366212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa85d-bd27-45de-91c0-202a289b1254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:49.366590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fa85d-bd27-45de-91c0-202a289b1254 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:49.368080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fa85d-bd27-45de-91c0-202a289b1254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:49.370222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fa85d-bd27-45de-91c0-202a289b1254 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:49.384174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 917/1824] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:49.388107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b2ab-ca34-4322-b2ec-2d82a6e1ef73 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:49.409944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4b2ab-ca34-4322-b2ec-2d82a6e1ef73 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:49.417547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cbcb2-f6a7-4cbf-92d0-1f2a0144f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:49.418675 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cbcb2-f6a7-4cbf-92d0-1f2a0144f2fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:49.420175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cbcb2-f6a7-4cbf-92d0-1f2a0144f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:49.420175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cbcb2-f6a7-4cbf-92d0-1f2a0144f2fb admin admin] PATH_INFO: `/v3/projects/4aa73b33b884493a9fac73609de33b80/users/769c1ab657714cc9bd081b7c242e9636/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:49.443782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4735a-f8d8-4cc0-87dc-b8a58c3258a0 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:49.444300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4735a-f8d8-4cc0-87dc-b8a58c3258a0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:49.444720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4735a-f8d8-4cc0-87dc-b8a58c3258a0 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:49.446371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 918/1825] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 15:22:49.470499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1a7e3-fda6-4bf4-b4f8-0bef3ac23bd4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:49.471652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1a7e3-fda6-4bf4-b4f8-0bef3ac23bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:49.472855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1a7e3-fda6-4bf4-b4f8-0bef3ac23bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:49.479071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cbcb2-f6a7-4cbf-92d0-1f2a0144f2fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa73b33b884493a9fac73609de33b80, user_id=769c1ab657714cc9bd081b7c242e9636, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:49.483830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cbcb2-f6a7-4cbf-92d0-1f2a0144f2fb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:49.508155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9dc1a7e3-fda6-4bf4-b4f8-0bef3ac23bd4 None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:49.509804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9dc1a7e3-fda6-4bf4-b4f8-0bef3ac23bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:49.514966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 908/1826] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:49 2022] PUT /identity/v3/projects/4aa73b33b884493a9fac73609de33b80/users/769c1ab657714cc9bd081b7c242e9636/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:49.520307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d70df-9ef6-41f2-859a-e4549967c7cb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:49.520594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d70df-9ef6-41f2-859a-e4549967c7cb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:49.520866 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d70df-9ef6-41f2-859a-e4549967c7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:49.605832 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-578d70df-9ef6-41f2-859a-e4549967c7cb None None] MFA Rules not processed for user `769c1ab657714cc9bd081b7c242e9636`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:49.606848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-578d70df-9ef6-41f2-859a-e4549967c7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:49.724985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 919/1827] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:22:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:49.726441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1167d-01d7-415b-aa3b-938f4d8c5ebf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:49.727477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1167d-01d7-415b-aa3b-938f4d8c5ebf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:49.727763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1167d-01d7-415b-aa3b-938f4d8c5ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:49.779814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 909/1828] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:22:49.779814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d70df-9ef6-41f2-859a-e4549967c7cb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:49.804770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-66d1167d-01d7-415b-aa3b-938f4d8c5ebf None None] MFA Rules not processed for user `717e02bd761d4116a2b2c40a90c73847`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:49.806171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-66d1167d-01d7-415b-aa3b-938f4d8c5ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:49.921393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d70df-9ef6-41f2-859a-e4549967c7cb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:49.935989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 920/1829] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:49.937554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1167d-01d7-415b-aa3b-938f4d8c5ebf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:49.938734 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdeaa7a-b438-4271-8293-ae5082bf2c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:49.939361 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeaa7a-b438-4271-8293-ae5082bf2c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:49.939640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeaa7a-b438-4271-8293-ae5082bf2c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:49.939909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdeaa7a-b438-4271-8293-ae5082bf2c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:49.940543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdeaa7a-b438-4271-8293-ae5082bf2c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:49.940819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-66d1167d-01d7-415b-aa3b-938f4d8c5ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:49.945995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdeaa7a-b438-4271-8293-ae5082bf2c3d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:49.990518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1167d-01d7-415b-aa3b-938f4d8c5ebf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:50.013771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e39ed-daa4-4ed2-8608-908c1b0a43bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:50.014539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e39ed-daa4-4ed2-8608-908c1b0a43bd service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:50.014726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e39ed-daa4-4ed2-8608-908c1b0a43bd service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:50.015011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e39ed-daa4-4ed2-8608-908c1b0a43bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:50.018886 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 910/1830] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:22:49 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:50.020181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce9a9-5246-4fb1-8a06-e1bb1978d97b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:50.020466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce9a9-5246-4fb1-8a06-e1bb1978d97b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:50.020738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ce9a9-5246-4fb1-8a06-e1bb1978d97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:50.061823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-248ce9a9-5246-4fb1-8a06-e1bb1978d97b None None] MFA Rules not processed for user `2fb553c5747c4878ad4545b4beaaf6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:50.064462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-248ce9a9-5246-4fb1-8a06-e1bb1978d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:50.067229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e39ed-daa4-4ed2-8608-908c1b0a43bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:50.069112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e39ed-daa4-4ed2-8608-908c1b0a43bd service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:50.081777 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:50.109390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 921/1831] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:50.110474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e39ed-daa4-4ed2-8608-908c1b0a43bd service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:50.135251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e39ed-daa4-4ed2-8608-908c1b0a43bd service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:50.200843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 911/1832] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:50.271590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:50.294640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9928c-399d-46cd-b407-eceaeaaa328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:50.295446 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9928c-399d-46cd-b407-eceaeaaa328e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:50.295728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9928c-399d-46cd-b407-eceaeaaa328e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:50.296002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9928c-399d-46cd-b407-eceaeaaa328e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:50.296632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9928c-399d-46cd-b407-eceaeaaa328e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:50.298604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9928c-399d-46cd-b407-eceaeaaa328e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:50.344468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 922/1833] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:22:50 2022] POST /identity/v3/users => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:22:50.349044 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce9a9-5246-4fb1-8a06-e1bb1978d97b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:50.366361 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ce9a9-5246-4fb1-8a06-e1bb1978d97b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:50.386284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dadd42-f12c-4b7b-a4de-1a2dc01f81f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:50.387043 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dadd42-f12c-4b7b-a4de-1a2dc01f81f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:50.387357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dadd42-f12c-4b7b-a4de-1a2dc01f81f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:50.387635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dadd42-f12c-4b7b-a4de-1a2dc01f81f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:50.388351 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dadd42-f12c-4b7b-a4de-1a2dc01f81f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:50.390464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dadd42-f12c-4b7b-a4de-1a2dc01f81f2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:50.408727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 912/1834] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:22:50.412871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9928c-399d-46cd-b407-eceaeaaa328e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:50.424599 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9928c-399d-46cd-b407-eceaeaaa328e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:50.439111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62ac86-222d-4626-b70e-fb9635b3a636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:50.439973 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ac86-222d-4626-b70e-fb9635b3a636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:50.440420 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ac86-222d-4626-b70e-fb9635b3a636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:50.440843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62ac86-222d-4626-b70e-fb9635b3a636 admin admin] PATH_INFO: `/v3/projects/fe49df04f3d44a0d81ad1587cafe6f92/users/9e04511810f84a29b9827fd1ee08af9a/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:50.477263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62ac86-222d-4626-b70e-fb9635b3a636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe49df04f3d44a0d81ad1587cafe6f92, user_id=9e04511810f84a29b9827fd1ee08af9a, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:50.478487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dadd42-f12c-4b7b-a4de-1a2dc01f81f2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:50.489076 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62ac86-222d-4626-b70e-fb9635b3a636 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:50.518742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 923/1835] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:50 2022] PUT /identity/v3/projects/fe49df04f3d44a0d81ad1587cafe6f92/users/9e04511810f84a29b9827fd1ee08af9a/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:50.523135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62ac86-222d-4626-b70e-fb9635b3a636 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:50.600819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dadd42-f12c-4b7b-a4de-1a2dc01f81f2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:50.652601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62ac86-222d-4626-b70e-fb9635b3a636 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:50.658268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9ed92-0d1a-43a9-b253-5b80dfa5871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:50.659142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ed92-0d1a-43a9-b253-5b80dfa5871a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:50.659606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ed92-0d1a-43a9-b253-5b80dfa5871a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:50.659986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9ed92-0d1a-43a9-b253-5b80dfa5871a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:50.660733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9ed92-0d1a-43a9-b253-5b80dfa5871a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:50.663920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9ed92-0d1a-43a9-b253-5b80dfa5871a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:50.677725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 924/1836] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:22:50.681832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9ed92-0d1a-43a9-b253-5b80dfa5871a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:50.693988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82870688-25db-43f1-8a4b-45a62e777792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:50.694887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870688-25db-43f1-8a4b-45a62e777792 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:50.695310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870688-25db-43f1-8a4b-45a62e777792 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:50.695770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870688-25db-43f1-8a4b-45a62e777792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:50.697370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9ed92-0d1a-43a9-b253-5b80dfa5871a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:50.699113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-82870688-25db-43f1-8a4b-45a62e777792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:50.706730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a53f4f-e0c0-4668-a8b0-5e639255f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:50.708075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a53f4f-e0c0-4668-a8b0-5e639255f125 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:50.708075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a53f4f-e0c0-4668-a8b0-5e639255f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:50.708518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a53f4f-e0c0-4668-a8b0-5e639255f125 admin admin] PATH_INFO: `/v3/projects/fe49df04f3d44a0d81ad1587cafe6f92/users/9e04511810f84a29b9827fd1ee08af9a/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:50.711107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a53f4f-e0c0-4668-a8b0-5e639255f125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe49df04f3d44a0d81ad1587cafe6f92, user_id=9e04511810f84a29b9827fd1ee08af9a, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:50.714974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a53f4f-e0c0-4668-a8b0-5e639255f125 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:50.731906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 925/1837] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:22:50 2022] PUT /identity/v3/projects/fe49df04f3d44a0d81ad1587cafe6f92/users/9e04511810f84a29b9827fd1ee08af9a/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:22:50.743691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c5e04-ea5f-4e65-a90a-45b80e8cf740 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:50.744134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c5e04-ea5f-4e65-a90a-45b80e8cf740 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:50.745339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c5e04-ea5f-4e65-a90a-45b80e8cf740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:50.763310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:22:50.779950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82870688-25db-43f1-8a4b-45a62e777792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:50.781872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82870688-25db-43f1-8a4b-45a62e777792 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:50.793551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 913/1838] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:22:50.796387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f08c5e04-ea5f-4e65-a90a-45b80e8cf740 None None] MFA Rules not processed for user `9e04511810f84a29b9827fd1ee08af9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:22:50.798948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f08c5e04-ea5f-4e65-a90a-45b80e8cf740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:50.929866 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 926/1839] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:22:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:22:50.945744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82870688-25db-43f1-8a4b-45a62e777792 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:50.947421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-82870688-25db-43f1-8a4b-45a62e777792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:22:51.024706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82870688-25db-43f1-8a4b-45a62e777792 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:51.091713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37543753-d193-477c-bb5d-da2f68014d63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:51.092637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37543753-d193-477c-bb5d-da2f68014d63 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:51.093789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37543753-d193-477c-bb5d-da2f68014d63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:51.095996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37543753-d193-477c-bb5d-da2f68014d63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:51.204498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37543753-d193-477c-bb5d-da2f68014d63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:51.206993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37543753-d193-477c-bb5d-da2f68014d63 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:51.230241 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 914/1840] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:22:55.722977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c5e04-ea5f-4e65-a90a-45b80e8cf740 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:22:55.735373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c5e04-ea5f-4e65-a90a-45b80e8cf740 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:22:55.739011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04f047-e22d-4d9a-8a7a-34a1f3328b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:22:55.739647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04f047-e22d-4d9a-8a7a-34a1f3328b9c service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:22:55.739922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04f047-e22d-4d9a-8a7a-34a1f3328b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:22:55.740188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04f047-e22d-4d9a-8a7a-34a1f3328b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:22:55.749499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04f047-e22d-4d9a-8a7a-34a1f3328b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:22:55.751480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04f047-e22d-4d9a-8a7a-34a1f3328b9c service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:22:55.761059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 927/1841] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:22:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:00.999769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37543753-d193-477c-bb5d-da2f68014d63 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:01.077512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:01.082143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37543753-d193-477c-bb5d-da2f68014d63 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:01.087476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:01.088124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:01.089090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:01.089090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] PATH_INFO: `/v3/users/769c1ab657714cc9bd081b7c242e9636` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:01.089994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=769c1ab657714cc9bd081b7c242e9636)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:01.092084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:01.141889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '769c1ab657714cc9bd081b7c242e9636'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:01.142575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '769c1ab657714cc9bd081b7c242e9636'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:01.143193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '769c1ab657714cc9bd081b7c242e9636'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:01.150949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '769c1ab657714cc9bd081b7c242e9636'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:01.159244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '769c1ab657714cc9bd081b7c242e9636'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:01.183637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 915/1842] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:00 2022] DELETE /identity/v3/users/769c1ab657714cc9bd081b7c242e9636 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:01.190901 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d072a77-3cfe-41c1-9e5b-53f3f036abc0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:01.192230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d072a77-3cfe-41c1-9e5b-53f3f036abc0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:01.192657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d072a77-3cfe-41c1-9e5b-53f3f036abc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:01.215368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3d072a77-3cfe-41c1-9e5b-53f3f036abc0 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:01.218483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3d072a77-3cfe-41c1-9e5b-53f3f036abc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:01.228991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:01.329910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 928/1843] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:01.341698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:01.343770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:01.408362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c363e-9c84-43f6-a21a-61c1c9d9c8fd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:01.413946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd205908-1afe-4991-97be-f4b6ece337ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:01.414740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd205908-1afe-4991-97be-f4b6ece337ff service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:01.415027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd205908-1afe-4991-97be-f4b6ece337ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:01.415302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd205908-1afe-4991-97be-f4b6ece337ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:01.427869 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd205908-1afe-4991-97be-f4b6ece337ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:01.429370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd205908-1afe-4991-97be-f4b6ece337ff service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:01.440936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 916/1844] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:01.820088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d072a77-3cfe-41c1-9e5b-53f3f036abc0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:01.821587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3d072a77-3cfe-41c1-9e5b-53f3f036abc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:01.854284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d072a77-3cfe-41c1-9e5b-53f3f036abc0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:01.859220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:01.859815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:01.860097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:01.860373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] PATH_INFO: `/v3/projects/4aa73b33b884493a9fac73609de33b80` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:01.861819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa73b33b884493a9fac73609de33b80)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:01.865504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:01.925374 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa73b33b884493a9fac73609de33b80', 'request_id': 'req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:01.932306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa73b33b884493a9fac73609de33b80', 'request_id': 'req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:01.948536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa73b33b884493a9fac73609de33b80', 'request_id': 'req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:01.961459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] The token cache is being invalidate because project 4aa73b33b884493a9fac73609de33b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:01.961757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:01.962711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:01.964326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 929/1845] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:01 2022] DELETE /identity/v3/projects/4aa73b33b884493a9fac73609de33b80 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:01.968632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd205908-1afe-4991-97be-f4b6ece337ff service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:01.980792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd205908-1afe-4991-97be-f4b6ece337ff service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:02.061838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebf50-93cd-44c2-bd45-a1d972a07385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:02.062718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebf50-93cd-44c2-bd45-a1d972a07385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:02.063081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebf50-93cd-44c2-bd45-a1d972a07385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:02.063468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebf50-93cd-44c2-bd45-a1d972a07385 admin admin] PATH_INFO: `/v3/users/9e04511810f84a29b9827fd1ee08af9a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:02.065298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ebf50-93cd-44c2-bd45-a1d972a07385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e04511810f84a29b9827fd1ee08af9a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:02.068031 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ebf50-93cd-44c2-bd45-a1d972a07385 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:02.131017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:02.177827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-135ebf50-93cd-44c2-bd45-a1d972a07385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e04511810f84a29b9827fd1ee08af9a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:02.179289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-135ebf50-93cd-44c2-bd45-a1d972a07385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e04511810f84a29b9827fd1ee08af9a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:02.180199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-135ebf50-93cd-44c2-bd45-a1d972a07385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e04511810f84a29b9827fd1ee08af9a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:02.191966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-135ebf50-93cd-44c2-bd45-a1d972a07385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e04511810f84a29b9827fd1ee08af9a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:02.211683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-135ebf50-93cd-44c2-bd45-a1d972a07385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e04511810f84a29b9827fd1ee08af9a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:02.257124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 917/1846] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:01 2022] DELETE /identity/v3/users/9e04511810f84a29b9827fd1ee08af9a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:02.692471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:02.696059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:02.724495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849492aa-4d21-4a0b-8e8f-3f4e592b2db4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:02.791723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:02.792437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:02.792717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:02.792954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] PATH_INFO: `/v3/projects/fe49df04f3d44a0d81ad1587cafe6f92` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:02.794692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe49df04f3d44a0d81ad1587cafe6f92)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:02.797079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:02.839371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:02.849231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe49df04f3d44a0d81ad1587cafe6f92', 'request_id': 'req-20e28e1e-161e-427f-b6dc-781ba484e1c3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:02.857034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe49df04f3d44a0d81ad1587cafe6f92', 'request_id': 'req-20e28e1e-161e-427f-b6dc-781ba484e1c3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:02.865368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe49df04f3d44a0d81ad1587cafe6f92', 'request_id': 'req-20e28e1e-161e-427f-b6dc-781ba484e1c3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:02.879691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] The token cache is being invalidate because project fe49df04f3d44a0d81ad1587cafe6f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:02.879989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:02.880656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e28e1e-161e-427f-b6dc-781ba484e1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:02.882639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 930/1847] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:02 2022] DELETE /identity/v3/projects/fe49df04f3d44a0d81ad1587cafe6f92 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:02.889389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ae611-d116-4e9e-b0ae-64cf8cb63a2e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:02.889717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ae611-d116-4e9e-b0ae-64cf8cb63a2e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:02.889995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ae611-d116-4e9e-b0ae-64cf8cb63a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:02.913005 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-307ae611-d116-4e9e-b0ae-64cf8cb63a2e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:02.914553 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-307ae611-d116-4e9e-b0ae-64cf8cb63a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:03.000520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 918/1848] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:03.009957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b294f6-f0a5-4f70-bc71-2983db5371c7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:03.010289 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b294f6-f0a5-4f70-bc71-2983db5371c7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:03.010568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b294f6-f0a5-4f70-bc71-2983db5371c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:03.031651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a5b294f6-f0a5-4f70-bc71-2983db5371c7 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:03.032962 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a5b294f6-f0a5-4f70-bc71-2983db5371c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:03.041700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 931/1849] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:03.046425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ae611-d116-4e9e-b0ae-64cf8cb63a2e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:03.057297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ae611-d116-4e9e-b0ae-64cf8cb63a2e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:03.062098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055291e-dcf2-4724-b43b-3980ee7da7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:03.062704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055291e-dcf2-4724-b43b-3980ee7da7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:03.062992 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055291e-dcf2-4724-b43b-3980ee7da7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:03.063270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055291e-dcf2-4724-b43b-3980ee7da7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:03.063922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055291e-dcf2-4724-b43b-3980ee7da7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:03.064229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055291e-dcf2-4724-b43b-3980ee7da7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:03.065889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055291e-dcf2-4724-b43b-3980ee7da7e6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:03.078772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 919/1850] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:03.083434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b294f6-f0a5-4f70-bc71-2983db5371c7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:03.093800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b294f6-f0a5-4f70-bc71-2983db5371c7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:03.099474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482f87b-f90b-40b8-b843-ac29deac1ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:03.100082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f87b-f90b-40b8-b843-ac29deac1ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:03.100364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f87b-f90b-40b8-b843-ac29deac1ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:03.100639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482f87b-f90b-40b8-b843-ac29deac1ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:03.101288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482f87b-f90b-40b8-b843-ac29deac1ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:03.103214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482f87b-f90b-40b8-b843-ac29deac1ae4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:03.130955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 932/1851] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:03 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:03.135014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055291e-dcf2-4724-b43b-3980ee7da7e6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:03.145186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055291e-dcf2-4724-b43b-3980ee7da7e6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:03.203629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db549ace-a2cf-4d79-9f45-c82bccbb5321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:03.204229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549ace-a2cf-4d79-9f45-c82bccbb5321 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:03.204510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549ace-a2cf-4d79-9f45-c82bccbb5321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:03.204783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db549ace-a2cf-4d79-9f45-c82bccbb5321 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:03.205438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db549ace-a2cf-4d79-9f45-c82bccbb5321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:03.207375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db549ace-a2cf-4d79-9f45-c82bccbb5321 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:03.228743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 920/1852] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:03 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:03.233071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482f87b-f90b-40b8-b843-ac29deac1ae4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:03.243944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482f87b-f90b-40b8-b843-ac29deac1ae4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:03.248530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64fb49-6513-4f2a-bebe-a16d2d5bbd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:03.249135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64fb49-6513-4f2a-bebe-a16d2d5bbd1e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:03.249415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64fb49-6513-4f2a-bebe-a16d2d5bbd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:03.249683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64fb49-6513-4f2a-bebe-a16d2d5bbd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:03.250366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64fb49-6513-4f2a-bebe-a16d2d5bbd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:03.252024 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64fb49-6513-4f2a-bebe-a16d2d5bbd1e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:03.262590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 933/1853] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:03.266701 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db549ace-a2cf-4d79-9f45-c82bccbb5321 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:03.276933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db549ace-a2cf-4d79-9f45-c82bccbb5321 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:03.281580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da556196-7527-4f47-9411-00c414f249fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:03.282221 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da556196-7527-4f47-9411-00c414f249fa admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:03.282505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da556196-7527-4f47-9411-00c414f249fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:03.282776 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da556196-7527-4f47-9411-00c414f249fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:03.283950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da556196-7527-4f47-9411-00c414f249fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:03.285521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da556196-7527-4f47-9411-00c414f249fa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:03.296436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 921/1854] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:03.301265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64fb49-6513-4f2a-bebe-a16d2d5bbd1e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:03.311386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64fb49-6513-4f2a-bebe-a16d2d5bbd1e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:03.316169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce857d-2289-4a39-b0e4-089a3ba7385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:03.316894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce857d-2289-4a39-b0e4-089a3ba7385d admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:03.317249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce857d-2289-4a39-b0e4-089a3ba7385d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:03.317592 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce857d-2289-4a39-b0e4-089a3ba7385d admin admin] PATH_INFO: `/v3/projects/b268d7199d084d21974cd1e44b96c18a/users/addc931ff43643439a5217de609e5003/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:03.333027 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce857d-2289-4a39-b0e4-089a3ba7385d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b268d7199d084d21974cd1e44b96c18a, user_id=addc931ff43643439a5217de609e5003, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:03.335874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce857d-2289-4a39-b0e4-089a3ba7385d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:03.351080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 934/1855] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:03 2022] PUT /identity/v3/projects/b268d7199d084d21974cd1e44b96c18a/users/addc931ff43643439a5217de609e5003/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:03.363406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffee494-0841-475f-9eae-333dfb3d4f6d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:03.363696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffee494-0841-475f-9eae-333dfb3d4f6d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:03.363973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffee494-0841-475f-9eae-333dfb3d4f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:03.372531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:03.394571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6ffee494-0841-475f-9eae-333dfb3d4f6d None None] MFA Rules not processed for user `addc931ff43643439a5217de609e5003`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:03.395784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6ffee494-0841-475f-9eae-333dfb3d4f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:03.461343 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 922/1856] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:03.473205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce857d-2289-4a39-b0e4-089a3ba7385d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:03.475437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-79ce857d-2289-4a39-b0e4-089a3ba7385d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:03.550435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce857d-2289-4a39-b0e4-089a3ba7385d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:03.554405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f7735-9737-4a80-814e-12d362c8a20d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:03.555258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f7735-9737-4a80-814e-12d362c8a20d service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:03.555615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f7735-9737-4a80-814e-12d362c8a20d service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:03.556138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f7735-9737-4a80-814e-12d362c8a20d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:03.568237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f7735-9737-4a80-814e-12d362c8a20d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:03.570117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f7735-9737-4a80-814e-12d362c8a20d service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:03.582155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 935/1857] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:05.674436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffee494-0841-475f-9eae-333dfb3d4f6d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:05.677485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6ffee494-0841-475f-9eae-333dfb3d4f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:05.752333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffee494-0841-475f-9eae-333dfb3d4f6d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:05.757027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:05.757668 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:05.758198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:05.758612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] PATH_INFO: `/v3/users/5ecd65d6dc844accacb7a3cccb633233` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:05.759774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ecd65d6dc844accacb7a3cccb633233)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:05.761861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:05.837146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ecd65d6dc844accacb7a3cccb633233'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:05.838201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ecd65d6dc844accacb7a3cccb633233'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:05.839571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ecd65d6dc844accacb7a3cccb633233'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:05.848837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ecd65d6dc844accacb7a3cccb633233'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:05.857219 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ecd65d6dc844accacb7a3cccb633233'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:05.880685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 923/1858] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:05 2022] DELETE /identity/v3/users/5ecd65d6dc844accacb7a3cccb633233 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:05.885104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d83cb-43a8-41ff-b1d9-b0bc2ed59204 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:05.885598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d83cb-43a8-41ff-b1d9-b0bc2ed59204 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:05.885676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d83cb-43a8-41ff-b1d9-b0bc2ed59204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:05.910769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-999d83cb-43a8-41ff-b1d9-b0bc2ed59204 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:05.912256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-999d83cb-43a8-41ff-b1d9-b0bc2ed59204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:06.001045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 936/1859] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:06.053525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:06.055210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:06.072975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:06.133619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c64d7-aa9b-43d7-ae37-df94bb8f8c98 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:06.137999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd094426-f4e3-46d2-9c0b-27e89a74a4c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:06.138778 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd094426-f4e3-46d2-9c0b-27e89a74a4c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:06.139061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd094426-f4e3-46d2-9c0b-27e89a74a4c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:06.139334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd094426-f4e3-46d2-9c0b-27e89a74a4c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:06.156906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd094426-f4e3-46d2-9c0b-27e89a74a4c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:06.158722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd094426-f4e3-46d2-9c0b-27e89a74a4c8 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:06.177325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 924/1860] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:06.852199 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d83cb-43a8-41ff-b1d9-b0bc2ed59204 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:06.854805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-999d83cb-43a8-41ff-b1d9-b0bc2ed59204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:06.907151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d83cb-43a8-41ff-b1d9-b0bc2ed59204 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:06.923227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:06.927784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:06.943973 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:06.945489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] PATH_INFO: `/v3/projects/0bec5865b5a14836b2110aeed347413a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:06.948938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bec5865b5a14836b2110aeed347413a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:06.956172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:06.962724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:07.070108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bec5865b5a14836b2110aeed347413a', 'request_id': 'req-3ed446a1-ca24-42c2-926b-8829e49f8dde'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.083875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bec5865b5a14836b2110aeed347413a', 'request_id': 'req-3ed446a1-ca24-42c2-926b-8829e49f8dde'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.113040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bec5865b5a14836b2110aeed347413a', 'request_id': 'req-3ed446a1-ca24-42c2-926b-8829e49f8dde'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.129253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] The token cache is being invalidate because project 0bec5865b5a14836b2110aeed347413a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:07.129253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.129879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.132576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 937/1861] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:06 2022] DELETE /identity/v3/projects/0bec5865b5a14836b2110aeed347413a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:07.136562 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd094426-f4e3-46d2-9c0b-27e89a74a4c8 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:07.149880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd094426-f4e3-46d2-9c0b-27e89a74a4c8 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:07.233909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbb46e-8882-4a2e-9a00-ebd3769ba2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:07.237982 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbb46e-8882-4a2e-9a00-ebd3769ba2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:07.238402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbb46e-8882-4a2e-9a00-ebd3769ba2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:07.238756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbb46e-8882-4a2e-9a00-ebd3769ba2b6 admin admin] PATH_INFO: `/v3/users/99f298562411422aac0980152cb716de` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:07.240081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbb46e-8882-4a2e-9a00-ebd3769ba2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f298562411422aac0980152cb716de)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:07.242341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbb46e-8882-4a2e-9a00-ebd3769ba2b6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:07.311924 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a9bbb46e-8882-4a2e-9a00-ebd3769ba2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f298562411422aac0980152cb716de'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.314836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a9bbb46e-8882-4a2e-9a00-ebd3769ba2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f298562411422aac0980152cb716de'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.315675 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a9bbb46e-8882-4a2e-9a00-ebd3769ba2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f298562411422aac0980152cb716de'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.326503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a9bbb46e-8882-4a2e-9a00-ebd3769ba2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f298562411422aac0980152cb716de'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.337521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a9bbb46e-8882-4a2e-9a00-ebd3769ba2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f298562411422aac0980152cb716de'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.364441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 925/1862] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:07 2022] DELETE /identity/v3/users/99f298562411422aac0980152cb716de => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:07.817558 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:07.819691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:07.835231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed446a1-ca24-42c2-926b-8829e49f8dde admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:07.904286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:07.904864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:07.905138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:07.905415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] PATH_INFO: `/v3/projects/ffc8590acc244d509c5ffdf7cb8d2dbc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:07.906608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc8590acc244d509c5ffdf7cb8d2dbc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:07.909139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:07.963534 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc8590acc244d509c5ffdf7cb8d2dbc', 'request_id': 'req-1c85f91e-3cad-4cd2-9079-cd6bd0007784'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.969519 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc8590acc244d509c5ffdf7cb8d2dbc', 'request_id': 'req-1c85f91e-3cad-4cd2-9079-cd6bd0007784'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.978728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc8590acc244d509c5ffdf7cb8d2dbc', 'request_id': 'req-1c85f91e-3cad-4cd2-9079-cd6bd0007784'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.991784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] The token cache is being invalidate because project ffc8590acc244d509c5ffdf7cb8d2dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:07.992184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.992941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1c85f91e-3cad-4cd2-9079-cd6bd0007784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:07.994854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 938/1863] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:07 2022] DELETE /identity/v3/projects/ffc8590acc244d509c5ffdf7cb8d2dbc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:08.000209 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d86b7-6dee-48f8-8732-840130a74099 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.000510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d86b7-6dee-48f8-8732-840130a74099 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.000793 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d86b7-6dee-48f8-8732-840130a74099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.021981 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f39d86b7-6dee-48f8-8732-840130a74099 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:08.023303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f39d86b7-6dee-48f8-8732-840130a74099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:08.054283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:08.086180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 926/1864] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:08.093832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699be778-b930-4940-bcb9-41cf48fb817a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.094139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699be778-b930-4940-bcb9-41cf48fb817a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.094417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699be778-b930-4940-bcb9-41cf48fb817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.115567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-699be778-b930-4940-bcb9-41cf48fb817a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:08.116794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-699be778-b930-4940-bcb9-41cf48fb817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:08.126079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 939/1865] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:08.130957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d86b7-6dee-48f8-8732-840130a74099 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:08.141610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d86b7-6dee-48f8-8732-840130a74099 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:08.147254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff274f-1711-4612-a7d6-4a520d56a685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:08.148179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff274f-1711-4612-a7d6-4a520d56a685 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.148568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff274f-1711-4612-a7d6-4a520d56a685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.148916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff274f-1711-4612-a7d6-4a520d56a685 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.149658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff274f-1711-4612-a7d6-4a520d56a685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:08.150053 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff274f-1711-4612-a7d6-4a520d56a685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:08.151807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff274f-1711-4612-a7d6-4a520d56a685 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:08.166836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 927/1866] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:23:08.171178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699be778-b930-4940-bcb9-41cf48fb817a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:08.181537 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699be778-b930-4940-bcb9-41cf48fb817a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:08.188755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c69ec9-99f0-4b09-9d73-70e67182863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:08.190079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c69ec9-99f0-4b09-9d73-70e67182863c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.190438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c69ec9-99f0-4b09-9d73-70e67182863c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.190781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c69ec9-99f0-4b09-9d73-70e67182863c admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.191489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c69ec9-99f0-4b09-9d73-70e67182863c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:08.193646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c69ec9-99f0-4b09-9d73-70e67182863c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:08.207535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:08.228344 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 940/1867] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:08 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:08.232597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff274f-1711-4612-a7d6-4a520d56a685 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:08.242786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff274f-1711-4612-a7d6-4a520d56a685 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:08.314734 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aacf20-c5a7-4521-be65-5a79bd03dd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:08.315481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aacf20-c5a7-4521-be65-5a79bd03dd02 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.315864 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aacf20-c5a7-4521-be65-5a79bd03dd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.316203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aacf20-c5a7-4521-be65-5a79bd03dd02 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.317063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aacf20-c5a7-4521-be65-5a79bd03dd02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:08.319626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aacf20-c5a7-4521-be65-5a79bd03dd02 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:08.342104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 928/1868] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:08 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:08.346912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c69ec9-99f0-4b09-9d73-70e67182863c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:08.357916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c69ec9-99f0-4b09-9d73-70e67182863c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:08.363376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef9fef-993a-4833-b847-5718eb6c7351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:08.363982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef9fef-993a-4833-b847-5718eb6c7351 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.364386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef9fef-993a-4833-b847-5718eb6c7351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.364668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef9fef-993a-4833-b847-5718eb6c7351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.365316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef9fef-993a-4833-b847-5718eb6c7351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:08.366951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef9fef-993a-4833-b847-5718eb6c7351 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:08.376879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 941/1869] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:08.380997 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aacf20-c5a7-4521-be65-5a79bd03dd02 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:08.391040 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aacf20-c5a7-4521-be65-5a79bd03dd02 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:08.395625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f4ec6-2c03-4e92-b72b-c71e66edfc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:08.396214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f4ec6-2c03-4e92-b72b-c71e66edfc16 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.396492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f4ec6-2c03-4e92-b72b-c71e66edfc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.396764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f4ec6-2c03-4e92-b72b-c71e66edfc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.397396 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f4ec6-2c03-4e92-b72b-c71e66edfc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:08.398998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f4ec6-2c03-4e92-b72b-c71e66edfc16 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:08.409963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 929/1870] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:08.414339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef9fef-993a-4833-b847-5718eb6c7351 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:08.424837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef9fef-993a-4833-b847-5718eb6c7351 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:08.429448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6059-5d47-4ad6-bafb-51eb320616fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:08.430133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6059-5d47-4ad6-bafb-51eb320616fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.430417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6059-5d47-4ad6-bafb-51eb320616fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.430694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6059-5d47-4ad6-bafb-51eb320616fb admin admin] PATH_INFO: `/v3/projects/e5a6eaeef20944d28a0d3d734bd4afe5/users/3f41bff6202a456585015aaba61ea069/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.445168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf6059-5d47-4ad6-bafb-51eb320616fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a6eaeef20944d28a0d3d734bd4afe5, user_id=3f41bff6202a456585015aaba61ea069, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:08.447908 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf6059-5d47-4ad6-bafb-51eb320616fb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:08.461060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 942/1871] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:08 2022] PUT /identity/v3/projects/e5a6eaeef20944d28a0d3d734bd4afe5/users/3f41bff6202a456585015aaba61ea069/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:08.472067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672a34-2bc1-4be6-bbc5-8fe390dc4952 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.472355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672a34-2bc1-4be6-bbc5-8fe390dc4952 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.472627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6672a34-2bc1-4be6-bbc5-8fe390dc4952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.511226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c6672a34-2bc1-4be6-bbc5-8fe390dc4952 None None] MFA Rules not processed for user `3f41bff6202a456585015aaba61ea069`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:08.512642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c6672a34-2bc1-4be6-bbc5-8fe390dc4952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:08.627466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 930/1872] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:08.633113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6059-5d47-4ad6-bafb-51eb320616fb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:08.711245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6059-5d47-4ad6-bafb-51eb320616fb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:08.715935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6d2bc-8ec3-456b-962d-b5b21ed5279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:08.716547 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6d2bc-8ec3-456b-962d-b5b21ed5279b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.716829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6d2bc-8ec3-456b-962d-b5b21ed5279b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.717104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c6d2bc-8ec3-456b-962d-b5b21ed5279b admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.717744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6d2bc-8ec3-456b-962d-b5b21ed5279b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:08.719875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c6d2bc-8ec3-456b-962d-b5b21ed5279b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:08.748456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 943/1873] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:08 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:08.752464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6672a34-2bc1-4be6-bbc5-8fe390dc4952 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:08.766326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6672a34-2bc1-4be6-bbc5-8fe390dc4952 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:08.803225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:08.847380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953e62d-1a14-466f-91bf-0d1e02cd4833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:08.848022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953e62d-1a14-466f-91bf-0d1e02cd4833 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.848300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953e62d-1a14-466f-91bf-0d1e02cd4833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.848824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953e62d-1a14-466f-91bf-0d1e02cd4833 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.849484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953e62d-1a14-466f-91bf-0d1e02cd4833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:08.851407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953e62d-1a14-466f-91bf-0d1e02cd4833 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:08.872712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 931/1874] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:08 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:08.876637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6d2bc-8ec3-456b-962d-b5b21ed5279b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:08.887103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c6d2bc-8ec3-456b-962d-b5b21ed5279b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:08.891660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e6de7-cff1-42ff-9999-f4504aaf41ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:08.892263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e6de7-cff1-42ff-9999-f4504aaf41ec admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.893091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e6de7-cff1-42ff-9999-f4504aaf41ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.893373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e6de7-cff1-42ff-9999-f4504aaf41ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.894089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e6de7-cff1-42ff-9999-f4504aaf41ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:08.895825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e6de7-cff1-42ff-9999-f4504aaf41ec admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:08.907384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 944/1875] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:08.911945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953e62d-1a14-466f-91bf-0d1e02cd4833 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:08.924647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953e62d-1a14-466f-91bf-0d1e02cd4833 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:08.930435 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028672f9-482e-4553-bd04-81ebe24c73df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:08.931294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028672f9-482e-4553-bd04-81ebe24c73df admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:08.931669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028672f9-482e-4553-bd04-81ebe24c73df admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:08.932031 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028672f9-482e-4553-bd04-81ebe24c73df admin admin] PATH_INFO: `/v3/projects/e3913a2285a34e1a812cf2ca2aefe6cf/users/292c8c6603154888a06aeb7482a2a7ef/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:08.959547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028672f9-482e-4553-bd04-81ebe24c73df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3913a2285a34e1a812cf2ca2aefe6cf, user_id=292c8c6603154888a06aeb7482a2a7ef, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:08.962382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028672f9-482e-4553-bd04-81ebe24c73df admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:08.975234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 932/1876] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:08 2022] PUT /identity/v3/projects/e3913a2285a34e1a812cf2ca2aefe6cf/users/292c8c6603154888a06aeb7482a2a7ef/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:08.979116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e6de7-cff1-42ff-9999-f4504aaf41ec admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:08.988929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e6de7-cff1-42ff-9999-f4504aaf41ec admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:09.044256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b94e0e-1a4c-4981-90fb-2e838b357661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:09.044857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b94e0e-1a4c-4981-90fb-2e838b357661 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:09.045137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b94e0e-1a4c-4981-90fb-2e838b357661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:09.045409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b94e0e-1a4c-4981-90fb-2e838b357661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:09.046074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b94e0e-1a4c-4981-90fb-2e838b357661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:09.047651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b94e0e-1a4c-4981-90fb-2e838b357661 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:09.057307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 945/1877] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:09.062220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028672f9-482e-4553-bd04-81ebe24c73df admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:09.074286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028672f9-482e-4553-bd04-81ebe24c73df admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:09.080690 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a06407-6662-4046-af8d-dca7ef5d088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:09.081490 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a06407-6662-4046-af8d-dca7ef5d088f admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:09.081803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a06407-6662-4046-af8d-dca7ef5d088f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:09.082095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a06407-6662-4046-af8d-dca7ef5d088f admin admin] PATH_INFO: `/v3/projects/e3913a2285a34e1a812cf2ca2aefe6cf/users/292c8c6603154888a06aeb7482a2a7ef/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:09.085073 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a06407-6662-4046-af8d-dca7ef5d088f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3913a2285a34e1a812cf2ca2aefe6cf, user_id=292c8c6603154888a06aeb7482a2a7ef, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:09.087794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a06407-6662-4046-af8d-dca7ef5d088f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:09.101218 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 933/1878] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:09 2022] PUT /identity/v3/projects/e3913a2285a34e1a812cf2ca2aefe6cf/users/292c8c6603154888a06aeb7482a2a7ef/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:09.114476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e698ab4-17c9-4ae1-8c3e-ff99a63d239b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:09.114760 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e698ab4-17c9-4ae1-8c3e-ff99a63d239b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:09.115035 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e698ab4-17c9-4ae1-8c3e-ff99a63d239b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:09.145899 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6e698ab4-17c9-4ae1-8c3e-ff99a63d239b None None] MFA Rules not processed for user `292c8c6603154888a06aeb7482a2a7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:09.147463 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6e698ab4-17c9-4ae1-8c3e-ff99a63d239b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:09.162207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:09.236761 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 946/1879] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:09.248388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a06407-6662-4046-af8d-dca7ef5d088f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:09.253359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-43a06407-6662-4046-af8d-dca7ef5d088f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:09.325564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a06407-6662-4046-af8d-dca7ef5d088f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:09.329510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0018d-1b6f-4fc8-88a2-61bc560830e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:09.330205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0018d-1b6f-4fc8-88a2-61bc560830e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:09.330482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0018d-1b6f-4fc8-88a2-61bc560830e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:09.330908 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0018d-1b6f-4fc8-88a2-61bc560830e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:09.410427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0018d-1b6f-4fc8-88a2-61bc560830e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:09.412559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0018d-1b6f-4fc8-88a2-61bc560830e0 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:09.423326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 934/1880] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:09.693182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e698ab4-17c9-4ae1-8c3e-ff99a63d239b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:09.695431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6e698ab4-17c9-4ae1-8c3e-ff99a63d239b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:09.777776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e698ab4-17c9-4ae1-8c3e-ff99a63d239b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:09.785149 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:09.785905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:09.786471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:09.787072 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] PATH_INFO: `/v3/users/addc931ff43643439a5217de609e5003` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:09.788478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=addc931ff43643439a5217de609e5003)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:09.791579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:09.880307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'addc931ff43643439a5217de609e5003'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:09.888089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'addc931ff43643439a5217de609e5003'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:09.903643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'addc931ff43643439a5217de609e5003'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:09.914335 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'addc931ff43643439a5217de609e5003'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:09.915136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'addc931ff43643439a5217de609e5003'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:09.926717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 947/1881] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:09 2022] DELETE /identity/v3/users/addc931ff43643439a5217de609e5003 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:09.928654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd29db-0ef9-4a8d-b979-72f315e248ee None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:09.928950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd29db-0ef9-4a8d-b979-72f315e248ee None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:09.929225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd29db-0ef9-4a8d-b979-72f315e248ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:09.950716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8acd29db-0ef9-4a8d-b979-72f315e248ee None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:09.951739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8acd29db-0ef9-4a8d-b979-72f315e248ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:09.991002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:10.038176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 935/1882] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:10.070227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:10.071862 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:10.117272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:10.189060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd10151-616e-4d45-a6f1-aa121bed3da9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:10.194246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be7106-5649-4b16-9aaa-50d609dbb1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:10.194882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be7106-5649-4b16-9aaa-50d609dbb1dc service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:10.195166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be7106-5649-4b16-9aaa-50d609dbb1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:10.195442 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be7106-5649-4b16-9aaa-50d609dbb1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:10.211097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be7106-5649-4b16-9aaa-50d609dbb1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:10.214578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be7106-5649-4b16-9aaa-50d609dbb1dc service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:10.227714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 948/1883] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:10.499779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd29db-0ef9-4a8d-b979-72f315e248ee None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:10.501348 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8acd29db-0ef9-4a8d-b979-72f315e248ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:10.514415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd29db-0ef9-4a8d-b979-72f315e248ee None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:10.519761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:10.520400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:10.520681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:10.520956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] PATH_INFO: `/v3/projects/b268d7199d084d21974cd1e44b96c18a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:10.522555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b268d7199d084d21974cd1e44b96c18a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:10.524634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:10.571941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b268d7199d084d21974cd1e44b96c18a', 'request_id': 'req-54655993-5b34-4b10-ba81-856d2443b161'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:10.577426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b268d7199d084d21974cd1e44b96c18a', 'request_id': 'req-54655993-5b34-4b10-ba81-856d2443b161'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:10.585238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b268d7199d084d21974cd1e44b96c18a', 'request_id': 'req-54655993-5b34-4b10-ba81-856d2443b161'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:10.596546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] The token cache is being invalidate because project b268d7199d084d21974cd1e44b96c18a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:10.596836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:10.597468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-54655993-5b34-4b10-ba81-856d2443b161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:10.599269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 936/1884] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:10 2022] DELETE /identity/v3/projects/b268d7199d084d21974cd1e44b96c18a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:10.604001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f04364-3f2b-4809-996c-a4edb8b76896 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:10.604295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f04364-3f2b-4809-996c-a4edb8b76896 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:10.604573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f04364-3f2b-4809-996c-a4edb8b76896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:10.623350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d0f04364-3f2b-4809-996c-a4edb8b76896 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:10.624541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d0f04364-3f2b-4809-996c-a4edb8b76896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:10.683507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 949/1885] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:10.691821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6fc1-024e-4e07-abde-000c42ba88ce None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:10.692108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6fc1-024e-4e07-abde-000c42ba88ce None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:10.692384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db6fc1-024e-4e07-abde-000c42ba88ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:10.712311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-74db6fc1-024e-4e07-abde-000c42ba88ce None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:10.713499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-74db6fc1-024e-4e07-abde-000c42ba88ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:10.721373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 937/1886] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:10.725926 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f04364-3f2b-4809-996c-a4edb8b76896 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:10.735748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f04364-3f2b-4809-996c-a4edb8b76896 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:10.740307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce333684-de1a-49c7-8a83-5d5194f0ab80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:10.740916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333684-de1a-49c7-8a83-5d5194f0ab80 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:10.741199 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333684-de1a-49c7-8a83-5d5194f0ab80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:10.741477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333684-de1a-49c7-8a83-5d5194f0ab80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:10.742154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce333684-de1a-49c7-8a83-5d5194f0ab80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:10.742516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce333684-de1a-49c7-8a83-5d5194f0ab80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:10.744051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce333684-de1a-49c7-8a83-5d5194f0ab80 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:10.756444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 950/1887] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:10.760717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db6fc1-024e-4e07-abde-000c42ba88ce None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:10.770599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db6fc1-024e-4e07-abde-000c42ba88ce None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:10.775192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245ee86-fc32-493a-94cf-8840f64ec177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:10.776418 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245ee86-fc32-493a-94cf-8840f64ec177 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:10.776701 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245ee86-fc32-493a-94cf-8840f64ec177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:10.776972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245ee86-fc32-493a-94cf-8840f64ec177 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:10.777670 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245ee86-fc32-493a-94cf-8840f64ec177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:10.779564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245ee86-fc32-493a-94cf-8840f64ec177 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:10.807792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 938/1888] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:10 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:10.812303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce333684-de1a-49c7-8a83-5d5194f0ab80 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:10.823050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce333684-de1a-49c7-8a83-5d5194f0ab80 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:10.882951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccb772-4f39-4a9d-bcfd-cd0f0d223a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:10.883697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccb772-4f39-4a9d-bcfd-cd0f0d223a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:10.883993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccb772-4f39-4a9d-bcfd-cd0f0d223a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:10.884342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccb772-4f39-4a9d-bcfd-cd0f0d223a5e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:10.884981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccb772-4f39-4a9d-bcfd-cd0f0d223a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:10.886924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccb772-4f39-4a9d-bcfd-cd0f0d223a5e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:10.913221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 951/1889] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:10 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:10.917517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245ee86-fc32-493a-94cf-8840f64ec177 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:10.928050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245ee86-fc32-493a-94cf-8840f64ec177 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:10.932707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb357e-4518-4b38-a3e9-0f89232f2a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:10.933304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb357e-4518-4b38-a3e9-0f89232f2a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:10.933586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb357e-4518-4b38-a3e9-0f89232f2a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:10.933976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb357e-4518-4b38-a3e9-0f89232f2a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:10.934534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb357e-4518-4b38-a3e9-0f89232f2a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:10.936116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb357e-4518-4b38-a3e9-0f89232f2a0c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:10.945919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 939/1890] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:10.949874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccb772-4f39-4a9d-bcfd-cd0f0d223a5e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:10.960492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccb772-4f39-4a9d-bcfd-cd0f0d223a5e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:10.965304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7326c-0682-4e5e-9c7c-c48b4e7a3ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:10.965912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7326c-0682-4e5e-9c7c-c48b4e7a3ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:10.966242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7326c-0682-4e5e-9c7c-c48b4e7a3ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:10.966517 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7326c-0682-4e5e-9c7c-c48b4e7a3ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:10.967197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7326c-0682-4e5e-9c7c-c48b4e7a3ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:10.968847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7326c-0682-4e5e-9c7c-c48b4e7a3ab1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:10.981320 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 952/1891] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:10.985712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb357e-4518-4b38-a3e9-0f89232f2a0c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:10.998924 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb357e-4518-4b38-a3e9-0f89232f2a0c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:11.005388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc285b-4109-404f-b514-e5e7b8764abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:11.006065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc285b-4109-404f-b514-e5e7b8764abe admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:11.006344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc285b-4109-404f-b514-e5e7b8764abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:11.006630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc285b-4109-404f-b514-e5e7b8764abe admin admin] PATH_INFO: `/v3/projects/d04132a1107f4235a8baae531da547ba/users/4bdac0550c224bb59bb8a70bfaac36f6/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:11.022488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc285b-4109-404f-b514-e5e7b8764abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04132a1107f4235a8baae531da547ba, user_id=4bdac0550c224bb59bb8a70bfaac36f6, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:11.025658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc285b-4109-404f-b514-e5e7b8764abe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:11.040348 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 940/1892] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:10 2022] PUT /identity/v3/projects/d04132a1107f4235a8baae531da547ba/users/4bdac0550c224bb59bb8a70bfaac36f6/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:11.051668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94f9e1-0f54-44c9-877e-e56a82e4454c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:11.051954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94f9e1-0f54-44c9-877e-e56a82e4454c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:11.052227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94f9e1-0f54-44c9-877e-e56a82e4454c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:11.084341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5a94f9e1-0f54-44c9-877e-e56a82e4454c None None] MFA Rules not processed for user `4bdac0550c224bb59bb8a70bfaac36f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:11.085564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a94f9e1-0f54-44c9-877e-e56a82e4454c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:11.115573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:11.151829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 953/1893] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:11.164113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc285b-4109-404f-b514-e5e7b8764abe admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:11.165792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fedc285b-4109-404f-b514-e5e7b8764abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:11.229060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc285b-4109-404f-b514-e5e7b8764abe admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:11.233350 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b3ab7-b9ff-4628-a419-b6bc19bd330d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:11.234104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b3ab7-b9ff-4628-a419-b6bc19bd330d service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:11.234397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b3ab7-b9ff-4628-a419-b6bc19bd330d service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:11.234671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b3ab7-b9ff-4628-a419-b6bc19bd330d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:11.244564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b3ab7-b9ff-4628-a419-b6bc19bd330d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:11.246052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b3ab7-b9ff-4628-a419-b6bc19bd330d service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:11.255216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:11.262469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 941/1894] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:12.123854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94f9e1-0f54-44c9-877e-e56a82e4454c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:12.125442 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5a94f9e1-0f54-44c9-877e-e56a82e4454c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:12.138065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94f9e1-0f54-44c9-877e-e56a82e4454c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:12.142522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be791f-0875-4687-b2b5-503becb9de40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:12.143139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be791f-0875-4687-b2b5-503becb9de40 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:12.143419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be791f-0875-4687-b2b5-503becb9de40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:12.143691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be791f-0875-4687-b2b5-503becb9de40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:12.145500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-81be791f-0875-4687-b2b5-503becb9de40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:12.213677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be791f-0875-4687-b2b5-503becb9de40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:12.215184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be791f-0875-4687-b2b5-503becb9de40 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:12.229957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 954/1895] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:18.065718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b3ab7-b9ff-4628-a419-b6bc19bd330d service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:18.074380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b3ab7-b9ff-4628-a419-b6bc19bd330d service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:18.077992 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3476ac3-30ed-401c-96c2-9e2c1528de1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:18.078611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3476ac3-30ed-401c-96c2-9e2c1528de1d service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:18.078891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3476ac3-30ed-401c-96c2-9e2c1528de1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:18.079164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3476ac3-30ed-401c-96c2-9e2c1528de1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:18.081178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f3476ac3-30ed-401c-96c2-9e2c1528de1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:18.146673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3476ac3-30ed-401c-96c2-9e2c1528de1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:18.148349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3476ac3-30ed-401c-96c2-9e2c1528de1d service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:18.157996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 942/1896] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:22.225265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=44 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:22.816423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be791f-0875-4687-b2b5-503becb9de40 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:22.817993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-81be791f-0875-4687-b2b5-503becb9de40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:22.931220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be791f-0875-4687-b2b5-503becb9de40 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:22.937670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eceaf-5c8e-4985-9242-7c1cfc2be3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:22.938683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eceaf-5c8e-4985-9242-7c1cfc2be3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:22.939286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eceaf-5c8e-4985-9242-7c1cfc2be3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:22.939711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eceaf-5c8e-4985-9242-7c1cfc2be3c1 admin admin] PATH_INFO: `/v3/users/9546b7c51b1747ff8d6f5faca3857b34` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:22.942729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eceaf-5c8e-4985-9242-7c1cfc2be3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9546b7c51b1747ff8d6f5faca3857b34)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:22.946253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eceaf-5c8e-4985-9242-7c1cfc2be3c1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:23.027326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-040eceaf-5c8e-4985-9242-7c1cfc2be3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9546b7c51b1747ff8d6f5faca3857b34'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:23.042278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-040eceaf-5c8e-4985-9242-7c1cfc2be3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9546b7c51b1747ff8d6f5faca3857b34'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:23.070813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-040eceaf-5c8e-4985-9242-7c1cfc2be3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9546b7c51b1747ff8d6f5faca3857b34'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:23.080276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-040eceaf-5c8e-4985-9242-7c1cfc2be3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9546b7c51b1747ff8d6f5faca3857b34'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:23.081436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-040eceaf-5c8e-4985-9242-7c1cfc2be3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9546b7c51b1747ff8d6f5faca3857b34'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:23.091149 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 955/1897] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:22 2022] DELETE /identity/v3/users/9546b7c51b1747ff8d6f5faca3857b34 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:23.302196 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3476ac3-30ed-401c-96c2-9e2c1528de1d service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:23.319250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3476ac3-30ed-401c-96c2-9e2c1528de1d service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:23.410381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:23.411509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:23.412098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:23.413564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] PATH_INFO: `/v3/projects/7f5f3049ce26467dbb70cfc2c57833d1` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:23.415142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f5f3049ce26467dbb70cfc2c57833d1)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:23.417287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:23.479050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f5f3049ce26467dbb70cfc2c57833d1', 'request_id': 'req-547065f9-f520-407d-9297-bc15c256b9f7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:23.485564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f5f3049ce26467dbb70cfc2c57833d1', 'request_id': 'req-547065f9-f520-407d-9297-bc15c256b9f7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:23.501997 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f5f3049ce26467dbb70cfc2c57833d1', 'request_id': 'req-547065f9-f520-407d-9297-bc15c256b9f7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:23.519067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] The token cache is being invalidate because project 7f5f3049ce26467dbb70cfc2c57833d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:23.519459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:23.520177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-547065f9-f520-407d-9297-bc15c256b9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:23.522101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 943/1898] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:23 2022] DELETE /identity/v3/projects/7f5f3049ce26467dbb70cfc2c57833d1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:23.527143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18019b05-5437-4611-81d7-76c18135017b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:23.527581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18019b05-5437-4611-81d7-76c18135017b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:23.527755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18019b05-5437-4611-81d7-76c18135017b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:23.550640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-18019b05-5437-4611-81d7-76c18135017b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:23.552666 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-18019b05-5437-4611-81d7-76c18135017b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:23.624660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 956/1899] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:23.633803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5035ee-8a3b-4b54-ac83-09aba3bd2199 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:23.634175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5035ee-8a3b-4b54-ac83-09aba3bd2199 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:23.634454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5035ee-8a3b-4b54-ac83-09aba3bd2199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:23.654189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2c5035ee-8a3b-4b54-ac83-09aba3bd2199 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:23.655404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2c5035ee-8a3b-4b54-ac83-09aba3bd2199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:23.663956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 944/1900] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:23.668029 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18019b05-5437-4611-81d7-76c18135017b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:23.677980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18019b05-5437-4611-81d7-76c18135017b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:23.682550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a026c-ad7e-4d01-bead-c00aa29296f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:23.683143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a026c-ad7e-4d01-bead-c00aa29296f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:23.683420 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a026c-ad7e-4d01-bead-c00aa29296f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:23.683690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a026c-ad7e-4d01-bead-c00aa29296f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:23.684330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a026c-ad7e-4d01-bead-c00aa29296f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:23.684632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a026c-ad7e-4d01-bead-c00aa29296f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:23.686232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a026c-ad7e-4d01-bead-c00aa29296f4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:23.697596 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 957/1901] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:23.701843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5035ee-8a3b-4b54-ac83-09aba3bd2199 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:23.711739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5035ee-8a3b-4b54-ac83-09aba3bd2199 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:23.716481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d12af-d793-481d-b84e-176e58e47a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:23.717080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d12af-d793-481d-b84e-176e58e47a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:23.717359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d12af-d793-481d-b84e-176e58e47a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:23.717632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d12af-d793-481d-b84e-176e58e47a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:23.718340 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d12af-d793-481d-b84e-176e58e47a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:23.720177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d12af-d793-481d-b84e-176e58e47a12 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:23.736986 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:23.749476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 945/1902] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:23 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:23.753656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a026c-ad7e-4d01-bead-c00aa29296f4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:23.763447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a026c-ad7e-4d01-bead-c00aa29296f4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:23.767109 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:23.822987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1360e71-351c-476c-9e1c-9bea16f78f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:23.823595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1360e71-351c-476c-9e1c-9bea16f78f21 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:23.823877 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1360e71-351c-476c-9e1c-9bea16f78f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:23.824152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1360e71-351c-476c-9e1c-9bea16f78f21 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:23.824805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1360e71-351c-476c-9e1c-9bea16f78f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:23.826761 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1360e71-351c-476c-9e1c-9bea16f78f21 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:23.849491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 958/1903] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:23 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:23.853651 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d12af-d793-481d-b84e-176e58e47a12 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:23.864194 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d12af-d793-481d-b84e-176e58e47a12 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:23.869108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123df4c3-8aeb-4cb1-aabe-ae196b111253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:23.869710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df4c3-8aeb-4cb1-aabe-ae196b111253 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:23.869989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df4c3-8aeb-4cb1-aabe-ae196b111253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:23.870297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123df4c3-8aeb-4cb1-aabe-ae196b111253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:23.870944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123df4c3-8aeb-4cb1-aabe-ae196b111253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:23.872540 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123df4c3-8aeb-4cb1-aabe-ae196b111253 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:23.882470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 946/1904] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:23.886644 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1360e71-351c-476c-9e1c-9bea16f78f21 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:23.897180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1360e71-351c-476c-9e1c-9bea16f78f21 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:23.901711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2184b7-6c15-4376-9c7a-ba58bd7febbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:23.902341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2184b7-6c15-4376-9c7a-ba58bd7febbb admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:23.902624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2184b7-6c15-4376-9c7a-ba58bd7febbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:23.902900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2184b7-6c15-4376-9c7a-ba58bd7febbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:23.903629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2184b7-6c15-4376-9c7a-ba58bd7febbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:23.905237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2184b7-6c15-4376-9c7a-ba58bd7febbb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:23.916343 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 959/1905] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:23.920395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123df4c3-8aeb-4cb1-aabe-ae196b111253 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:23.930346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123df4c3-8aeb-4cb1-aabe-ae196b111253 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:23.934933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c46ec-4b04-4f06-8a86-b30b2cd18149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:23.935583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c46ec-4b04-4f06-8a86-b30b2cd18149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:23.935865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c46ec-4b04-4f06-8a86-b30b2cd18149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:23.936139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c46ec-4b04-4f06-8a86-b30b2cd18149 admin admin] PATH_INFO: `/v3/projects/73ec54404f4544b3aade58089decab7d/users/aae746a8450b4103b2e52252e796c4f9/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:23.951345 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c46ec-4b04-4f06-8a86-b30b2cd18149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ec54404f4544b3aade58089decab7d, user_id=aae746a8450b4103b2e52252e796c4f9, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:23.954488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c46ec-4b04-4f06-8a86-b30b2cd18149 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:23.967796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 947/1906] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:23 2022] PUT /identity/v3/projects/73ec54404f4544b3aade58089decab7d/users/aae746a8450b4103b2e52252e796c4f9/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:23.977946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93ed54-1bc5-4aa5-93bb-058e17c0147b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:23.978277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93ed54-1bc5-4aa5-93bb-058e17c0147b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:23.978550 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93ed54-1bc5-4aa5-93bb-058e17c0147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:24.006346 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6b93ed54-1bc5-4aa5-93bb-058e17c0147b None None] MFA Rules not processed for user `aae746a8450b4103b2e52252e796c4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:24.007557 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6b93ed54-1bc5-4aa5-93bb-058e17c0147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:24.073481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 960/1907] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:24.078214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c46ec-4b04-4f06-8a86-b30b2cd18149 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:24.141782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c46ec-4b04-4f06-8a86-b30b2cd18149 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:24.147211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03b473-ca4d-4941-bd1a-1050affe5eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:24.147823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b473-ca4d-4941-bd1a-1050affe5eca admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:24.148111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b473-ca4d-4941-bd1a-1050affe5eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:24.148399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b473-ca4d-4941-bd1a-1050affe5eca admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:24.149024 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03b473-ca4d-4941-bd1a-1050affe5eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:24.150978 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03b473-ca4d-4941-bd1a-1050affe5eca admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:24.182954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 948/1908] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:24 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:24.187689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93ed54-1bc5-4aa5-93bb-058e17c0147b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:24.200498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93ed54-1bc5-4aa5-93bb-058e17c0147b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:24.271938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e851388-0d72-4294-9843-1ba8541f21fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:24.272556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851388-0d72-4294-9843-1ba8541f21fa admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:24.272923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851388-0d72-4294-9843-1ba8541f21fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:24.273102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851388-0d72-4294-9843-1ba8541f21fa admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:24.273731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e851388-0d72-4294-9843-1ba8541f21fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:24.275774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e851388-0d72-4294-9843-1ba8541f21fa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:24.296792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 961/1909] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:24 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:24.301355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03b473-ca4d-4941-bd1a-1050affe5eca admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:24.312093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03b473-ca4d-4941-bd1a-1050affe5eca admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:24.317674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded21715-5c42-4e95-83ec-f09fb85813d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:24.318328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded21715-5c42-4e95-83ec-f09fb85813d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:24.318604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded21715-5c42-4e95-83ec-f09fb85813d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:24.318874 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded21715-5c42-4e95-83ec-f09fb85813d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:24.319518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded21715-5c42-4e95-83ec-f09fb85813d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:24.321093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded21715-5c42-4e95-83ec-f09fb85813d1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:24.332106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 949/1910] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:24.336642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e851388-0d72-4294-9843-1ba8541f21fa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:24.343240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:24.348792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e851388-0d72-4294-9843-1ba8541f21fa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:24.353991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e63511-fadf-43b2-bc89-83ebaca54ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:24.354711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e63511-fadf-43b2-bc89-83ebaca54ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:24.354993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e63511-fadf-43b2-bc89-83ebaca54ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:24.355270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e63511-fadf-43b2-bc89-83ebaca54ab2 admin admin] PATH_INFO: `/v3/projects/973ddf0be8cd436d9ea7666f35becc36/users/39cee56494964ea3a86e7b41a5a330d8/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:24.370670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e63511-fadf-43b2-bc89-83ebaca54ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973ddf0be8cd436d9ea7666f35becc36, user_id=39cee56494964ea3a86e7b41a5a330d8, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:24.373332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e63511-fadf-43b2-bc89-83ebaca54ab2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:24.387182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 962/1911] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:24 2022] PUT /identity/v3/projects/973ddf0be8cd436d9ea7666f35becc36/users/39cee56494964ea3a86e7b41a5a330d8/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:24.391051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded21715-5c42-4e95-83ec-f09fb85813d1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:24.402506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded21715-5c42-4e95-83ec-f09fb85813d1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:24.487028 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0efbd2-f136-4a15-a9e2-77c0ffc099f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:24.487716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efbd2-f136-4a15-a9e2-77c0ffc099f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:24.488747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efbd2-f136-4a15-a9e2-77c0ffc099f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:24.489107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0efbd2-f136-4a15-a9e2-77c0ffc099f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:24.489899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0efbd2-f136-4a15-a9e2-77c0ffc099f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:24.491851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0efbd2-f136-4a15-a9e2-77c0ffc099f4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:24.507437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 950/1912] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:24.508752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e63511-fadf-43b2-bc89-83ebaca54ab2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:24.519398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e63511-fadf-43b2-bc89-83ebaca54ab2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:24.526763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae5598-a06e-434b-af61-7364a64e1dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:24.527538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae5598-a06e-434b-af61-7364a64e1dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:24.528110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae5598-a06e-434b-af61-7364a64e1dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:24.528218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae5598-a06e-434b-af61-7364a64e1dab admin admin] PATH_INFO: `/v3/projects/973ddf0be8cd436d9ea7666f35becc36/users/39cee56494964ea3a86e7b41a5a330d8/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:24.530379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae5598-a06e-434b-af61-7364a64e1dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=973ddf0be8cd436d9ea7666f35becc36, user_id=39cee56494964ea3a86e7b41a5a330d8, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:24.533117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae5598-a06e-434b-af61-7364a64e1dab admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:24.543967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 963/1913] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:24 2022] PUT /identity/v3/projects/973ddf0be8cd436d9ea7666f35becc36/users/39cee56494964ea3a86e7b41a5a330d8/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:24.554660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71829cf6-d1bf-4485-8408-3449a692e4a8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:24.554946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71829cf6-d1bf-4485-8408-3449a692e4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:24.555230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71829cf6-d1bf-4485-8408-3449a692e4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:24.583369 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-71829cf6-d1bf-4485-8408-3449a692e4a8 None None] MFA Rules not processed for user `39cee56494964ea3a86e7b41a5a330d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:24.584611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-71829cf6-d1bf-4485-8408-3449a692e4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:24.603661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:24.656549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 951/1914] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:24.669794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae5598-a06e-434b-af61-7364a64e1dab admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:24.671844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d0ae5598-a06e-434b-af61-7364a64e1dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:24.733558 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae5598-a06e-434b-af61-7364a64e1dab admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:24.737875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d562-11ce-4143-9af6-6950a4f71ed5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:24.739091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d562-11ce-4143-9af6-6950a4f71ed5 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:24.739623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d562-11ce-4143-9af6-6950a4f71ed5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:24.739623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078d562-11ce-4143-9af6-6950a4f71ed5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:24.751576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078d562-11ce-4143-9af6-6950a4f71ed5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:24.753010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078d562-11ce-4143-9af6-6950a4f71ed5 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:24.763165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 964/1915] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:24.841141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71829cf6-d1bf-4485-8408-3449a692e4a8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:24.854303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71829cf6-d1bf-4485-8408-3449a692e4a8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:24.856079 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a2f0d-2d2a-49cc-be0a-5e54acdaeeb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:24.856709 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a2f0d-2d2a-49cc-be0a-5e54acdaeeb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:24.856986 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a2f0d-2d2a-49cc-be0a-5e54acdaeeb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:24.857256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a2f0d-2d2a-49cc-be0a-5e54acdaeeb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:24.915211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a2f0d-2d2a-49cc-be0a-5e54acdaeeb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:24.916646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a2f0d-2d2a-49cc-be0a-5e54acdaeeb4 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:24.925627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 952/1916] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:25.569314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d562-11ce-4143-9af6-6950a4f71ed5 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:25.570782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8078d562-11ce-4143-9af6-6950a4f71ed5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:25.635387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078d562-11ce-4143-9af6-6950a4f71ed5 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:25.639897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:25.640522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:25.640804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:25.641079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] PATH_INFO: `/v3/users/3f41bff6202a456585015aaba61ea069` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:25.642226 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f41bff6202a456585015aaba61ea069)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:25.644134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:25.689246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f41bff6202a456585015aaba61ea069'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:25.697092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f41bff6202a456585015aaba61ea069'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:25.708257 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:25.709482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f41bff6202a456585015aaba61ea069'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:25.718284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f41bff6202a456585015aaba61ea069'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:25.719046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f41bff6202a456585015aaba61ea069'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:25.725478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 965/1917] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:25 2022] DELETE /identity/v3/users/3f41bff6202a456585015aaba61ea069 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:25.729899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd3f6-39bb-4838-afb3-e993479655b8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:25.730718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd3f6-39bb-4838-afb3-e993479655b8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:25.730718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd3f6-39bb-4838-afb3-e993479655b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:25.749447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6edbd3f6-39bb-4838-afb3-e993479655b8 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:25.750661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6edbd3f6-39bb-4838-afb3-e993479655b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:25.809885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 953/1918] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:25.820121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:25.821506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:25.877720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7684eff-ee27-48b2-8e5b-62c125189a00 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:25.883158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2355c-d8c4-4b86-bcb7-9ec3bb34c21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:25.883271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2355c-d8c4-4b86-bcb7-9ec3bb34c21f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:25.883467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2355c-d8c4-4b86-bcb7-9ec3bb34c21f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:25.884259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2355c-d8c4-4b86-bcb7-9ec3bb34c21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:25.894756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2355c-d8c4-4b86-bcb7-9ec3bb34c21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:25.896279 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2355c-d8c4-4b86-bcb7-9ec3bb34c21f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:25.906908 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 966/1919] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:26.220455 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbd3f6-39bb-4838-afb3-e993479655b8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:26.221906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6edbd3f6-39bb-4838-afb3-e993479655b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:26.254302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbd3f6-39bb-4838-afb3-e993479655b8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:26.270720 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:26.271369 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:26.271645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:26.272253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] PATH_INFO: `/v3/projects/e5a6eaeef20944d28a0d3d734bd4afe5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:26.273610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a6eaeef20944d28a0d3d734bd4afe5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:26.276034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:26.328939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a6eaeef20944d28a0d3d734bd4afe5', 'request_id': 'req-99e37654-f18e-4d04-a2d0-3eda2e789f58'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.330809 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:26.336966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a6eaeef20944d28a0d3d734bd4afe5', 'request_id': 'req-99e37654-f18e-4d04-a2d0-3eda2e789f58'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.346913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a6eaeef20944d28a0d3d734bd4afe5', 'request_id': 'req-99e37654-f18e-4d04-a2d0-3eda2e789f58'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.359893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] The token cache is being invalidate because project e5a6eaeef20944d28a0d3d734bd4afe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:26.360188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.360883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.362514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 954/1920] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:26 2022] DELETE /identity/v3/projects/e5a6eaeef20944d28a0d3d734bd4afe5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:26.367505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2355c-d8c4-4b86-bcb7-9ec3bb34c21f service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:26.377822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2355c-d8c4-4b86-bcb7-9ec3bb34c21f service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:26.452837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47219d07-4747-4b4e-9f70-a3e82e361d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:26.452837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47219d07-4747-4b4e-9f70-a3e82e361d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:26.452837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47219d07-4747-4b4e-9f70-a3e82e361d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:26.453242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47219d07-4747-4b4e-9f70-a3e82e361d53 admin admin] PATH_INFO: `/v3/users/292c8c6603154888a06aeb7482a2a7ef` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:26.454679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47219d07-4747-4b4e-9f70-a3e82e361d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=292c8c6603154888a06aeb7482a2a7ef)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:26.456914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47219d07-4747-4b4e-9f70-a3e82e361d53 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:26.520764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-47219d07-4747-4b4e-9f70-a3e82e361d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292c8c6603154888a06aeb7482a2a7ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.532036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-47219d07-4747-4b4e-9f70-a3e82e361d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292c8c6603154888a06aeb7482a2a7ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.546590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-47219d07-4747-4b4e-9f70-a3e82e361d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292c8c6603154888a06aeb7482a2a7ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.556949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-47219d07-4747-4b4e-9f70-a3e82e361d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292c8c6603154888a06aeb7482a2a7ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.560125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-47219d07-4747-4b4e-9f70-a3e82e361d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292c8c6603154888a06aeb7482a2a7ef'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.569933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 967/1921] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:26 2022] DELETE /identity/v3/users/292c8c6603154888a06aeb7482a2a7ef => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:26.601551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:26.603068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:26.617107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e37654-f18e-4d04-a2d0-3eda2e789f58 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:26.702613 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:26.703599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:26.703915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:26.704189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] PATH_INFO: `/v3/users/4bdac0550c224bb59bb8a70bfaac36f6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:26.705348 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bdac0550c224bb59bb8a70bfaac36f6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:26.707945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:26.758404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bdac0550c224bb59bb8a70bfaac36f6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.759084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bdac0550c224bb59bb8a70bfaac36f6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.759727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bdac0550c224bb59bb8a70bfaac36f6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.767560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bdac0550c224bb59bb8a70bfaac36f6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.775233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bdac0550c224bb59bb8a70bfaac36f6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:26.793645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 955/1922] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:26 2022] DELETE /identity/v3/users/4bdac0550c224bb59bb8a70bfaac36f6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:26.798793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f12e3-bec6-4af6-8fb0-a6ddee8e3485 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:26.799151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f12e3-bec6-4af6-8fb0-a6ddee8e3485 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:26.799488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f12e3-bec6-4af6-8fb0-a6ddee8e3485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:26.819168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-424f12e3-bec6-4af6-8fb0-a6ddee8e3485 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:26.820387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-424f12e3-bec6-4af6-8fb0-a6ddee8e3485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:26.825397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:26.868238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:26.870172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:26.904741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 968/1923] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:26.914325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f12e3-bec6-4af6-8fb0-a6ddee8e3485 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:26.915749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-424f12e3-bec6-4af6-8fb0-a6ddee8e3485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:26.938907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:26.944284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8fd5b-f0cf-4574-b340-985232a570d9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:26.950739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:26.951733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:26.952163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:26.952583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] PATH_INFO: `/v3/projects/e3913a2285a34e1a812cf2ca2aefe6cf` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:26.953865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3913a2285a34e1a812cf2ca2aefe6cf)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:26.956277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:26.977220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f12e3-bec6-4af6-8fb0-a6ddee8e3485 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:26.981617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950221f-7b25-41ef-b1bd-9f756b8dd11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:26.982268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950221f-7b25-41ef-b1bd-9f756b8dd11c service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:26.982556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950221f-7b25-41ef-b1bd-9f756b8dd11c service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:26.982835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950221f-7b25-41ef-b1bd-9f756b8dd11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:26.993061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950221f-7b25-41ef-b1bd-9f756b8dd11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:26.994940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950221f-7b25-41ef-b1bd-9f756b8dd11c service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.004640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 969/1924] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:27.005245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3913a2285a34e1a812cf2ca2aefe6cf', 'request_id': 'req-be0f7674-928a-48a2-863b-59b5f933b8c3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:27.010968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3913a2285a34e1a812cf2ca2aefe6cf', 'request_id': 'req-be0f7674-928a-48a2-863b-59b5f933b8c3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:27.019708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3913a2285a34e1a812cf2ca2aefe6cf', 'request_id': 'req-be0f7674-928a-48a2-863b-59b5f933b8c3'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:27.031243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] The token cache is being invalidate because project e3913a2285a34e1a812cf2ca2aefe6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:27.031540 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:27.032201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-be0f7674-928a-48a2-863b-59b5f933b8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:27.033722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 956/1925] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:26 2022] DELETE /identity/v3/projects/e3913a2285a34e1a812cf2ca2aefe6cf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:27.039226 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307123ab-545e-4285-8c9e-4d164562dfb6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.039519 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307123ab-545e-4285-8c9e-4d164562dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.039789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307123ab-545e-4285-8c9e-4d164562dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.060053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-307123ab-545e-4285-8c9e-4d164562dfb6 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:27.061858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-307123ab-545e-4285-8c9e-4d164562dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:27.130349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 970/1926] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:27.132295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484640c3-12d2-4a81-b4fd-d1dcbd8d9f23 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.132589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484640c3-12d2-4a81-b4fd-d1dcbd8d9f23 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.132866 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484640c3-12d2-4a81-b4fd-d1dcbd8d9f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.154224 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-484640c3-12d2-4a81-b4fd-d1dcbd8d9f23 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:27.155453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-484640c3-12d2-4a81-b4fd-d1dcbd8d9f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:27.165167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 957/1927] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:27.169368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307123ab-545e-4285-8c9e-4d164562dfb6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.179665 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307123ab-545e-4285-8c9e-4d164562dfb6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.184418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7ef86-ebda-463d-8c0c-d3c492e5dd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.185026 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7ef86-ebda-463d-8c0c-d3c492e5dd0f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.185306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7ef86-ebda-463d-8c0c-d3c492e5dd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.185581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7ef86-ebda-463d-8c0c-d3c492e5dd0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.186636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7ef86-ebda-463d-8c0c-d3c492e5dd0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:27.186943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7ef86-ebda-463d-8c0c-d3c492e5dd0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.188544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7ef86-ebda-463d-8c0c-d3c492e5dd0f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.200016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 971/1928] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:27.204429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484640c3-12d2-4a81-b4fd-d1dcbd8d9f23 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.213917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484640c3-12d2-4a81-b4fd-d1dcbd8d9f23 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.218622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18462f86-ba71-41ff-becd-f6d5b0ebc67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.219227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18462f86-ba71-41ff-becd-f6d5b0ebc67e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.219507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18462f86-ba71-41ff-becd-f6d5b0ebc67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.219779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18462f86-ba71-41ff-becd-f6d5b0ebc67e admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.220419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18462f86-ba71-41ff-becd-f6d5b0ebc67e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.222989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18462f86-ba71-41ff-becd-f6d5b0ebc67e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.258131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 958/1929] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:27 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:27.259477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7ef86-ebda-463d-8c0c-d3c492e5dd0f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.270896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7ef86-ebda-463d-8c0c-d3c492e5dd0f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.300456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18462f86-ba71-41ff-becd-f6d5b0ebc67e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.303485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-18462f86-ba71-41ff-becd-f6d5b0ebc67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:27.324977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:27.344187 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eb7ab-0ba4-4bec-9441-3d7eea4d1136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.345029 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eb7ab-0ba4-4bec-9441-3d7eea4d1136 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.345490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eb7ab-0ba4-4bec-9441-3d7eea4d1136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.345912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eb7ab-0ba4-4bec-9441-3d7eea4d1136 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.346709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eb7ab-0ba4-4bec-9441-3d7eea4d1136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.350925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eb7ab-0ba4-4bec-9441-3d7eea4d1136 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.378694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 972/1930] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:27 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:27.381246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eb7ab-0ba4-4bec-9441-3d7eea4d1136 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.391223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eb7ab-0ba4-4bec-9441-3d7eea4d1136 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.398925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18462f86-ba71-41ff-becd-f6d5b0ebc67e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.399815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa7a91-c303-4908-abdc-9a7acb90f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.400633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7a91-c303-4908-abdc-9a7acb90f698 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.401865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7a91-c303-4908-abdc-9a7acb90f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.402361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7a91-c303-4908-abdc-9a7acb90f698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.403216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa7a91-c303-4908-abdc-9a7acb90f698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.403852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.404488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.404770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.405046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] PATH_INFO: `/v3/projects/d04132a1107f4235a8baae531da547ba` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.406220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04132a1107f4235a8baae531da547ba)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.406541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa7a91-c303-4908-abdc-9a7acb90f698 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.408315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.421698 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 973/1931] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:27.425769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa7a91-c303-4908-abdc-9a7acb90f698 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.438202 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa7a91-c303-4908-abdc-9a7acb90f698 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.456258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ba4c6-6fdc-444b-aaaa-d1e28ae6cdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.457486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba4c6-6fdc-444b-aaaa-d1e28ae6cdca admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.457858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba4c6-6fdc-444b-aaaa-d1e28ae6cdca admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.458341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ba4c6-6fdc-444b-aaaa-d1e28ae6cdca admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.459198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ba4c6-6fdc-444b-aaaa-d1e28ae6cdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.460914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ba4c6-6fdc-444b-aaaa-d1e28ae6cdca admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.461783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04132a1107f4235a8baae531da547ba', 'request_id': 'req-2828cc0d-eebb-49f3-b91f-29d37d69876f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:27.469944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04132a1107f4235a8baae531da547ba', 'request_id': 'req-2828cc0d-eebb-49f3-b91f-29d37d69876f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:27.472356 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 974/1932] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:27.476433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:27.477052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ba4c6-6fdc-444b-aaaa-d1e28ae6cdca admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.482768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04132a1107f4235a8baae531da547ba', 'request_id': 'req-2828cc0d-eebb-49f3-b91f-29d37d69876f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:27.488664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ba4c6-6fdc-444b-aaaa-d1e28ae6cdca admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.498915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] The token cache is being invalidate because project d04132a1107f4235a8baae531da547ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:27.499242 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:27.500806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2828cc0d-eebb-49f3-b91f-29d37d69876f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:27.502788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 959/1933] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:27 2022] DELETE /identity/v3/projects/d04132a1107f4235a8baae531da547ba => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:27.507550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82895295-abfc-4587-a285-6bad58f2fa9a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.507840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82895295-abfc-4587-a285-6bad58f2fa9a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.508985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82895295-abfc-4587-a285-6bad58f2fa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.533482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-82895295-abfc-4587-a285-6bad58f2fa9a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:27.535758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-82895295-abfc-4587-a285-6bad58f2fa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:27.569757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036685c-3f6a-4538-9450-4403c4f10de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.570462 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036685c-3f6a-4538-9450-4403c4f10de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.571010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036685c-3f6a-4538-9450-4403c4f10de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.571010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036685c-3f6a-4538-9450-4403c4f10de0 admin admin] PATH_INFO: `/v3/projects/e93a04e515d5481f9432764acd9c9062/users/f9f7163545ee457eb7b4eb85ba1780c2/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.591990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036685c-3f6a-4538-9450-4403c4f10de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93a04e515d5481f9432764acd9c9062, user_id=f9f7163545ee457eb7b4eb85ba1780c2, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.596456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036685c-3f6a-4538-9450-4403c4f10de0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.614004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 975/1934] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:27 2022] PUT /identity/v3/projects/e93a04e515d5481f9432764acd9c9062/users/f9f7163545ee457eb7b4eb85ba1780c2/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:27.626312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68fca2-18b1-4220-8f1a-6e2df0915e37 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.626312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68fca2-18b1-4220-8f1a-6e2df0915e37 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.626312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68fca2-18b1-4220-8f1a-6e2df0915e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.638636 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 960/1935] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:27.640165 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dddb7-d3e7-4301-a8a6-3038d03a18bd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.640452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dddb7-d3e7-4301-a8a6-3038d03a18bd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.640728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770dddb7-d3e7-4301-a8a6-3038d03a18bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.657944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ca68fca2-18b1-4220-8f1a-6e2df0915e37 None None] MFA Rules not processed for user `f9f7163545ee457eb7b4eb85ba1780c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:27.659376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ca68fca2-18b1-4220-8f1a-6e2df0915e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:27.662855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-770dddb7-d3e7-4301-a8a6-3038d03a18bd None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:27.664103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-770dddb7-d3e7-4301-a8a6-3038d03a18bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:27.744321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 976/1936] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:27.750715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68fca2-18b1-4220-8f1a-6e2df0915e37 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.752552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ca68fca2-18b1-4220-8f1a-6e2df0915e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:27.759101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 961/1937] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:27.761545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dddb7-d3e7-4301-a8a6-3038d03a18bd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.773231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770dddb7-d3e7-4301-a8a6-3038d03a18bd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.774175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68fca2-18b1-4220-8f1a-6e2df0915e37 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.780952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65190f-568b-406f-9f31-65b8594b4d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.781818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65190f-568b-406f-9f31-65b8594b4d55 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.782307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65190f-568b-406f-9f31-65b8594b4d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.782416 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7705c7-2ee8-4921-ab65-eff51bdedc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.782647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65190f-568b-406f-9f31-65b8594b4d55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.783156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7705c7-2ee8-4921-ab65-eff51bdedc10 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.783402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7705c7-2ee8-4921-ab65-eff51bdedc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.783504 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65190f-568b-406f-9f31-65b8594b4d55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:27.783725 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7705c7-2ee8-4921-ab65-eff51bdedc10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.783827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65190f-568b-406f-9f31-65b8594b4d55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.785010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7705c7-2ee8-4921-ab65-eff51bdedc10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.785774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65190f-568b-406f-9f31-65b8594b4d55 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.787566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7705c7-2ee8-4921-ab65-eff51bdedc10 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.802088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 962/1938] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:27.804932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65190f-568b-406f-9f31-65b8594b4d55 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.820689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:27.821514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65190f-568b-406f-9f31-65b8594b4d55 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.832483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8cf53-6280-45b7-bdf7-b64d967dcf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.832964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cf53-6280-45b7-bdf7-b64d967dcf95 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.833258 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cf53-6280-45b7-bdf7-b64d967dcf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.833477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 977/1939] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:27 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:27.833555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8cf53-6280-45b7-bdf7-b64d967dcf95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.834246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8cf53-6280-45b7-bdf7-b64d967dcf95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.834353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7705c7-2ee8-4921-ab65-eff51bdedc10 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.836089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8cf53-6280-45b7-bdf7-b64d967dcf95 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.891472 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 963/1940] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:27 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:27.896286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8cf53-6280-45b7-bdf7-b64d967dcf95 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:27.926500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7705c7-2ee8-4921-ab65-eff51bdedc10 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.983601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:27.986905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecbdfa-c259-4068-a35a-48d6217d8134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.987528 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecbdfa-c259-4068-a35a-48d6217d8134 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.988746 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecbdfa-c259-4068-a35a-48d6217d8134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.989038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aecbdfa-c259-4068-a35a-48d6217d8134 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.989487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8cf53-6280-45b7-bdf7-b64d967dcf95 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:27.989680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecbdfa-c259-4068-a35a-48d6217d8134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.991897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aecbdfa-c259-4068-a35a-48d6217d8134 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:27.995561 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751fb98-15ee-4ca9-b4f8-ec934c9ff259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:27.996314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751fb98-15ee-4ca9-b4f8-ec934c9ff259 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:27.996927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751fb98-15ee-4ca9-b4f8-ec934c9ff259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:27.997199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751fb98-15ee-4ca9-b4f8-ec934c9ff259 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:27.997819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751fb98-15ee-4ca9-b4f8-ec934c9ff259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:27.999807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751fb98-15ee-4ca9-b4f8-ec934c9ff259 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:28.017584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 978/1941] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:27 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:28.018706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecbdfa-c259-4068-a35a-48d6217d8134 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:28.024343 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 964/1942] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:27 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:28.025889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751fb98-15ee-4ca9-b4f8-ec934c9ff259 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:28.029116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aecbdfa-c259-4068-a35a-48d6217d8134 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:28.034553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11cda2-3259-4a72-856a-18862f3fbfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:28.035207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11cda2-3259-4a72-856a-18862f3fbfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.035508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11cda2-3259-4a72-856a-18862f3fbfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.035602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751fb98-15ee-4ca9-b4f8-ec934c9ff259 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:28.035796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11cda2-3259-4a72-856a-18862f3fbfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.036445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11cda2-3259-4a72-856a-18862f3fbfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:28.038110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11cda2-3259-4a72-856a-18862f3fbfe2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:28.040218 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c2ed8-9fce-42e2-be20-255c4bce0a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:28.040966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c2ed8-9fce-42e2-be20-255c4bce0a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.041251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c2ed8-9fce-42e2-be20-255c4bce0a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.041523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c2ed8-9fce-42e2-be20-255c4bce0a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.042210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c2ed8-9fce-42e2-be20-255c4bce0a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:28.043763 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c2ed8-9fce-42e2-be20-255c4bce0a43 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:28.051861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 979/1943] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:28.053090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11cda2-3259-4a72-856a-18862f3fbfe2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:28.057247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 965/1944] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:28.058229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c2ed8-9fce-42e2-be20-255c4bce0a43 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:28.063328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11cda2-3259-4a72-856a-18862f3fbfe2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:28.068259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c2ed8-9fce-42e2-be20-255c4bce0a43 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:28.068811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037aebb-6220-4386-a5ee-785e9c8ed71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:28.069456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037aebb-6220-4386-a5ee-785e9c8ed71b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.069763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037aebb-6220-4386-a5ee-785e9c8ed71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.070088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037aebb-6220-4386-a5ee-785e9c8ed71b admin admin] PATH_INFO: `/v3/projects/ea2e00ccdd704b6b85832c7210a248d5/users/0036163441e347199413b8e9e7ca6e23/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.073504 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a11b33-e5ad-4d25-bcbe-6a6c8f79ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:28.074138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a11b33-e5ad-4d25-bcbe-6a6c8f79ffdc admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.074424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a11b33-e5ad-4d25-bcbe-6a6c8f79ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.074700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a11b33-e5ad-4d25-bcbe-6a6c8f79ffdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.075411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a11b33-e5ad-4d25-bcbe-6a6c8f79ffdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:28.077124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a11b33-e5ad-4d25-bcbe-6a6c8f79ffdc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:28.084719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037aebb-6220-4386-a5ee-785e9c8ed71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2e00ccdd704b6b85832c7210a248d5, user_id=0036163441e347199413b8e9e7ca6e23, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:28.087405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037aebb-6220-4386-a5ee-785e9c8ed71b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:28.091570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 966/1945] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:28.092506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a11b33-e5ad-4d25-bcbe-6a6c8f79ffdc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:28.101512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 980/1946] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:28 2022] PUT /identity/v3/projects/ea2e00ccdd704b6b85832c7210a248d5/users/0036163441e347199413b8e9e7ca6e23/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:28.103893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a11b33-e5ad-4d25-bcbe-6a6c8f79ffdc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:28.105222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037aebb-6220-4386-a5ee-785e9c8ed71b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:28.162022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21001154-336d-4c3c-8b00-8011ba7b9891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:28.162710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21001154-336d-4c3c-8b00-8011ba7b9891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.162994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21001154-336d-4c3c-8b00-8011ba7b9891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.163314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21001154-336d-4c3c-8b00-8011ba7b9891 admin admin] PATH_INFO: `/v3/projects/41a3f7b4160f4cc5a9a4947769cd2816/users/74f8f4db5d1c411393351121d1a0671f/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.168374 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037aebb-6220-4386-a5ee-785e9c8ed71b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:28.173632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb345a06-a157-417b-ae4c-22a83424a561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:28.174331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb345a06-a157-417b-ae4c-22a83424a561 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.174616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb345a06-a157-417b-ae4c-22a83424a561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.174884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb345a06-a157-417b-ae4c-22a83424a561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.176035 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb345a06-a157-417b-ae4c-22a83424a561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:28.177704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb345a06-a157-417b-ae4c-22a83424a561 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:28.178700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21001154-336d-4c3c-8b00-8011ba7b9891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a3f7b4160f4cc5a9a4947769cd2816, user_id=74f8f4db5d1c411393351121d1a0671f, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:28.179896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:28.181379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21001154-336d-4c3c-8b00-8011ba7b9891 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:28.192000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 981/1947] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:28.195869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb345a06-a157-417b-ae4c-22a83424a561 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:28.197558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 967/1948] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:28 2022] PUT /identity/v3/projects/41a3f7b4160f4cc5a9a4947769cd2816/users/74f8f4db5d1c411393351121d1a0671f/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:28.205592 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb345a06-a157-417b-ae4c-22a83424a561 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:28.207731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15edbc4-5cc7-41d1-ab7e-dfa8bacf072a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.208023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15edbc4-5cc7-41d1-ab7e-dfa8bacf072a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.208302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15edbc4-5cc7-41d1-ab7e-dfa8bacf072a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.235012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e15edbc4-5cc7-41d1-ab7e-dfa8bacf072a None None] MFA Rules not processed for user `74f8f4db5d1c411393351121d1a0671f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:28.236253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e15edbc4-5cc7-41d1-ab7e-dfa8bacf072a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:28.263717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb49ded-ce32-4798-aed2-1864ba82f57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:28.264385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49ded-ce32-4798-aed2-1864ba82f57f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.265086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49ded-ce32-4798-aed2-1864ba82f57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.265372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb49ded-ce32-4798-aed2-1864ba82f57f admin admin] PATH_INFO: `/v3/projects/ea2e00ccdd704b6b85832c7210a248d5/users/0036163441e347199413b8e9e7ca6e23/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.267396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb49ded-ce32-4798-aed2-1864ba82f57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2e00ccdd704b6b85832c7210a248d5, user_id=0036163441e347199413b8e9e7ca6e23, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:28.270188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb49ded-ce32-4798-aed2-1864ba82f57f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:28.280271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 982/1949] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:28 2022] PUT /identity/v3/projects/ea2e00ccdd704b6b85832c7210a248d5/users/0036163441e347199413b8e9e7ca6e23/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:28.290265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc2b0-7aeb-4e49-b143-5820f7f2b542 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.290558 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc2b0-7aeb-4e49-b143-5820f7f2b542 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.290835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc2b0-7aeb-4e49-b143-5820f7f2b542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.303539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 968/1950] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:28.315450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15edbc4-5cc7-41d1-ab7e-dfa8bacf072a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:28.317824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e15edbc4-5cc7-41d1-ab7e-dfa8bacf072a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:28.320252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bc0dc2b0-7aeb-4e49-b143-5820f7f2b542 None None] MFA Rules not processed for user `0036163441e347199413b8e9e7ca6e23`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:28.321571 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bc0dc2b0-7aeb-4e49-b143-5820f7f2b542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:28.358614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:28.390833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 983/1951] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:28.400175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15edbc4-5cc7-41d1-ab7e-dfa8bacf072a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:28.403447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc2b0-7aeb-4e49-b143-5820f7f2b542 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:28.404836 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bc0dc2b0-7aeb-4e49-b143-5820f7f2b542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:28.450891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382079b6-3a76-4b6c-b0db-8b00ea705986 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23bb3a6586247e0a11ece33569d6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:28.451492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382079b6-3a76-4b6c-b0db-8b00ea705986 service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.452270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382079b6-3a76-4b6c-b0db-8b00ea705986 service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.452540 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382079b6-3a76-4b6c-b0db-8b00ea705986 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.461401 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc2b0-7aeb-4e49-b143-5820f7f2b542 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:28.465077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a27a6a-9d5c-49a8-bf65-b3c3052465cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:28.465693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27a6a-9d5c-49a8-bf65-b3c3052465cc service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.465974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27a6a-9d5c-49a8-bf65-b3c3052465cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.466276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27a6a-9d5c-49a8-bf65-b3c3052465cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.476274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a27a6a-9d5c-49a8-bf65-b3c3052465cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:28.477722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a27a6a-9d5c-49a8-bf65-b3c3052465cc service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:28.488691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 984/1952] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:28.521476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382079b6-3a76-4b6c-b0db-8b00ea705986 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:28.523162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382079b6-3a76-4b6c-b0db-8b00ea705986 service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:28.536182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 969/1953] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:28.536709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a27a6a-9d5c-49a8-bf65-b3c3052465cc service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:28.538409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a7a27a6a-9d5c-49a8-bf65-b3c3052465cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:28.550172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a27a6a-9d5c-49a8-bf65-b3c3052465cc service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:28.554513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e76d1-0a97-4de7-bb28-861b4616e843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:28.555145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e76d1-0a97-4de7-bb28-861b4616e843 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:28.555430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e76d1-0a97-4de7-bb28-861b4616e843 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:28.555704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e76d1-0a97-4de7-bb28-861b4616e843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:28.573473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:28.616500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e76d1-0a97-4de7-bb28-861b4616e843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:28.617987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e76d1-0a97-4de7-bb28-861b4616e843 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:28.627194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 985/1954] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:32.133011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382079b6-3a76-4b6c-b0db-8b00ea705986 service glance] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:32.198516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382079b6-3a76-4b6c-b0db-8b00ea705986 service glance] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:32.208774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa835e-526b-4349-afe2-4aa30bc30397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:32.209501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa835e-526b-4349-afe2-4aa30bc30397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:32.209718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa835e-526b-4349-afe2-4aa30bc30397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:32.209997 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa835e-526b-4349-afe2-4aa30bc30397 admin admin] PATH_INFO: `/v3/users/f9f7163545ee457eb7b4eb85ba1780c2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:32.211178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa835e-526b-4349-afe2-4aa30bc30397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f7163545ee457eb7b4eb85ba1780c2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:32.213144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa835e-526b-4349-afe2-4aa30bc30397 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:32.226120 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e76d1-0a97-4de7-bb28-861b4616e843 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:32.227748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-251e76d1-0a97-4de7-bb28-861b4616e843 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:32.243910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e76d1-0a97-4de7-bb28-861b4616e843 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:32.249177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f628c6-0fb4-458c-b25c-7ffe5557bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:32.249953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f628c6-0fb4-458c-b25c-7ffe5557bd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:32.250391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f628c6-0fb4-458c-b25c-7ffe5557bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:32.250605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f628c6-0fb4-458c-b25c-7ffe5557bd32 admin admin] PATH_INFO: `/v3/users/aae746a8450b4103b2e52252e796c4f9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:32.251806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f628c6-0fb4-458c-b25c-7ffe5557bd32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae746a8450b4103b2e52252e796c4f9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:32.253878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f628c6-0fb4-458c-b25c-7ffe5557bd32 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:32.256616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:32.274092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dbaa835e-526b-4349-afe2-4aa30bc30397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f7163545ee457eb7b4eb85ba1780c2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:32.274747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dbaa835e-526b-4349-afe2-4aa30bc30397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f7163545ee457eb7b4eb85ba1780c2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:32.275389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dbaa835e-526b-4349-afe2-4aa30bc30397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f7163545ee457eb7b4eb85ba1780c2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:32.284196 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dbaa835e-526b-4349-afe2-4aa30bc30397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f7163545ee457eb7b4eb85ba1780c2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:32.292940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-dbaa835e-526b-4349-afe2-4aa30bc30397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f7163545ee457eb7b4eb85ba1780c2'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:32.304919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7f628c6-0fb4-458c-b25c-7ffe5557bd32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae746a8450b4103b2e52252e796c4f9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:32.311694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 970/1955] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:32 2022] DELETE /identity/v3/users/f9f7163545ee457eb7b4eb85ba1780c2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:32.315007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7f628c6-0fb4-458c-b25c-7ffe5557bd32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae746a8450b4103b2e52252e796c4f9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:32.316819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d546f-c399-4385-83d5-e4271b4d417d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:32.317108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d546f-c399-4385-83d5-e4271b4d417d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:32.317384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d546f-c399-4385-83d5-e4271b4d417d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:32.327920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7f628c6-0fb4-458c-b25c-7ffe5557bd32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae746a8450b4103b2e52252e796c4f9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:32.335931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7f628c6-0fb4-458c-b25c-7ffe5557bd32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae746a8450b4103b2e52252e796c4f9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:32.336581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d7f628c6-0fb4-458c-b25c-7ffe5557bd32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae746a8450b4103b2e52252e796c4f9'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:32.337985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bc8d546f-c399-4385-83d5-e4271b4d417d None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:32.339395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bc8d546f-c399-4385-83d5-e4271b4d417d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:32.342942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 986/1956] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:32 2022] DELETE /identity/v3/users/aae746a8450b4103b2e52252e796c4f9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:32.347212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3424-af5d-4987-919e-ca048eb16c78 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:32.347521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3424-af5d-4987-919e-ca048eb16c78 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:32.347790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3424-af5d-4987-919e-ca048eb16c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:32.367831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-967c3424-af5d-4987-919e-ca048eb16c78 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:32.368944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-967c3424-af5d-4987-919e-ca048eb16c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:32.405295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 971/1957] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:32.415233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d546f-c399-4385-83d5-e4271b4d417d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:32.416702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bc8d546f-c399-4385-83d5-e4271b4d417d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:32.430369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 987/1958] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:32.442115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c3424-af5d-4987-919e-ca048eb16c78 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:32.443826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-967c3424-af5d-4987-919e-ca048eb16c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:32.475706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d546f-c399-4385-83d5-e4271b4d417d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:32.478080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:32.505810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c3424-af5d-4987-919e-ca048eb16c78 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:32.509588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d31d8-76b2-4100-8a50-59228e6e668d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:32.510238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d31d8-76b2-4100-8a50-59228e6e668d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:32.510526 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d31d8-76b2-4100-8a50-59228e6e668d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:32.510802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d31d8-76b2-4100-8a50-59228e6e668d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:32.519909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d31d8-76b2-4100-8a50-59228e6e668d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:32.521347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d31d8-76b2-4100-8a50-59228e6e668d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:32.533368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f1f2-447b-484b-beee-7391540830e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:32.534066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f1f2-447b-484b-beee-7391540830e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:32.534355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f1f2-447b-484b-beee-7391540830e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:32.534471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 988/1959] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:32.534705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f1f2-447b-484b-beee-7391540830e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:32.545046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126f1f2-447b-484b-beee-7391540830e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:32.546543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126f1f2-447b-484b-beee-7391540830e1 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:32.558672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 972/1960] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:33.023458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d31d8-76b2-4100-8a50-59228e6e668d service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:33.024882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-746d31d8-76b2-4100-8a50-59228e6e668d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:33.030629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f1f2-447b-484b-beee-7391540830e1 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:33.032196 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4126f1f2-447b-484b-beee-7391540830e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:33.047326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d31d8-76b2-4100-8a50-59228e6e668d service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:33.053666 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:33.054360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:33.054656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:33.054944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] PATH_INFO: `/v3/projects/e93a04e515d5481f9432764acd9c9062` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:33.056060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93a04e515d5481f9432764acd9c9062)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:33.058524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:33.061949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:33.077235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f1f2-447b-484b-beee-7391540830e1 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:33.090874 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:33.091648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:33.093137 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:33.093688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] PATH_INFO: `/v3/projects/73ec54404f4544b3aade58089decab7d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:33.096485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ec54404f4544b3aade58089decab7d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:33.102069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:33.125252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93a04e515d5481f9432764acd9c9062', 'request_id': 'req-d39f707b-2899-4022-a538-2d60c716dc36'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.132237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93a04e515d5481f9432764acd9c9062', 'request_id': 'req-d39f707b-2899-4022-a538-2d60c716dc36'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.141605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93a04e515d5481f9432764acd9c9062', 'request_id': 'req-d39f707b-2899-4022-a538-2d60c716dc36'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.155673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] The token cache is being invalidate because project e93a04e515d5481f9432764acd9c9062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:33.155967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.156768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.161338 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 989/1961] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:33 2022] DELETE /identity/v3/projects/e93a04e515d5481f9432764acd9c9062 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:33.162374 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:33.163683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:33.179176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ec54404f4544b3aade58089decab7d', 'request_id': 'req-a19199c1-e65a-4c7a-b287-2cdc2212d310'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.186601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ec54404f4544b3aade58089decab7d', 'request_id': 'req-a19199c1-e65a-4c7a-b287-2cdc2212d310'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.195943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ec54404f4544b3aade58089decab7d', 'request_id': 'req-a19199c1-e65a-4c7a-b287-2cdc2212d310'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.212030 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] The token cache is being invalidate because project 73ec54404f4544b3aade58089decab7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:33.212449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.213140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.214698 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 973/1962] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:33 2022] DELETE /identity/v3/projects/73ec54404f4544b3aade58089decab7d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:33.219026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:33.221439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:33.245790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f707b-2899-4022-a538-2d60c716dc36 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:33.324084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19199c1-e65a-4c7a-b287-2cdc2212d310 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:33.329084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:33.329715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:33.329993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:33.330298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] PATH_INFO: `/v3/users/39cee56494964ea3a86e7b41a5a330d8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:33.331555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39cee56494964ea3a86e7b41a5a330d8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:33.333647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e2fd9-0739-4a79-9863-d7c6f385b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:33.334064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:33.334311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e2fd9-0739-4a79-9863-d7c6f385b42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:33.334618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e2fd9-0739-4a79-9863-d7c6f385b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:33.334893 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e2fd9-0739-4a79-9863-d7c6f385b42f admin admin] PATH_INFO: `/v3/users/0036163441e347199413b8e9e7ca6e23` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:33.336035 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e2fd9-0739-4a79-9863-d7c6f385b42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0036163441e347199413b8e9e7ca6e23)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:33.337933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e2fd9-0739-4a79-9863-d7c6f385b42f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:33.343157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:33.386711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39cee56494964ea3a86e7b41a5a330d8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.387394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39cee56494964ea3a86e7b41a5a330d8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.388018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39cee56494964ea3a86e7b41a5a330d8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.391444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-601e2fd9-0739-4a79-9863-d7c6f385b42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0036163441e347199413b8e9e7ca6e23'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.396207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39cee56494964ea3a86e7b41a5a330d8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.399243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-601e2fd9-0739-4a79-9863-d7c6f385b42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0036163441e347199413b8e9e7ca6e23'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.403374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39cee56494964ea3a86e7b41a5a330d8'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.411795 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-601e2fd9-0739-4a79-9863-d7c6f385b42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0036163441e347199413b8e9e7ca6e23'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.420186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-601e2fd9-0739-4a79-9863-d7c6f385b42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0036163441e347199413b8e9e7ca6e23'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.420825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-601e2fd9-0739-4a79-9863-d7c6f385b42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0036163441e347199413b8e9e7ca6e23'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.423183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 974/1963] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:33 2022] DELETE /identity/v3/users/39cee56494964ea3a86e7b41a5a330d8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:33.430825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 990/1964] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:33 2022] DELETE /identity/v3/users/0036163441e347199413b8e9e7ca6e23 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:33.730718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:33.732182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:33.742648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:33.813170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab0d81-655c-493f-8d84-298a99cf16e1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:33.874531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:33.877617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:33.877899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:33.878191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] PATH_INFO: `/v3/projects/973ddf0be8cd436d9ea7666f35becc36` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:33.880890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973ddf0be8cd436d9ea7666f35becc36)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:33.882858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:33.943720 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973ddf0be8cd436d9ea7666f35becc36', 'request_id': 'req-6709fdc8-8efc-4e55-92da-e75a1ba39969'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.951238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973ddf0be8cd436d9ea7666f35becc36', 'request_id': 'req-6709fdc8-8efc-4e55-92da-e75a1ba39969'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.960117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973ddf0be8cd436d9ea7666f35becc36', 'request_id': 'req-6709fdc8-8efc-4e55-92da-e75a1ba39969'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.972811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] The token cache is being invalidate because project 973ddf0be8cd436d9ea7666f35becc36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:33.973699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.974386 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:33.975905 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 975/1965] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:33 2022] DELETE /identity/v3/projects/973ddf0be8cd436d9ea7666f35becc36 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:33.980701 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68331df6-ead0-4d24-89c4-e210a532e4d8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:33.980995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68331df6-ead0-4d24-89c4-e210a532e4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:33.981271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68331df6-ead0-4d24-89c4-e210a532e4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.008428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-68331df6-ead0-4d24-89c4-e210a532e4d8 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:34.009648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-68331df6-ead0-4d24-89c4-e210a532e4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:34.065304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.067539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:34.082560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 991/1966] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:34.090787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae7093-33bd-46cf-af60-10574f048014 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.091084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae7093-33bd-46cf-af60-10574f048014 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.091495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae7093-33bd-46cf-af60-10574f048014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.112274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-63ae7093-33bd-46cf-af60-10574f048014 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:34.113995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-63ae7093-33bd-46cf-af60-10574f048014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:34.121978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 992/1967] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:34.126141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae7093-33bd-46cf-af60-10574f048014 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.127728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:34.137756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae7093-33bd-46cf-af60-10574f048014 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.142879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044d1bb-861e-4f79-942a-daa541c7931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.143511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044d1bb-861e-4f79-942a-daa541c7931b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.143793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044d1bb-861e-4f79-942a-daa541c7931b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.144065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044d1bb-861e-4f79-942a-daa541c7931b admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.144733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044d1bb-861e-4f79-942a-daa541c7931b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:34.145031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044d1bb-861e-4f79-942a-daa541c7931b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.146652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044d1bb-861e-4f79-942a-daa541c7931b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.151219 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709fdc8-8efc-4e55-92da-e75a1ba39969 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.156045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.156680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.156963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.157233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] PATH_INFO: `/v3/projects/ea2e00ccdd704b6b85832c7210a248d5` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.158392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2e00ccdd704b6b85832c7210a248d5)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.162929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 993/1968] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:23:34.163100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.164355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044d1bb-861e-4f79-942a-daa541c7931b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.174541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044d1bb-861e-4f79-942a-daa541c7931b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.179612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793b10f-dc10-4e1f-9e62-2938a791e5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.180216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b10f-dc10-4e1f-9e62-2938a791e5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.180492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b10f-dc10-4e1f-9e62-2938a791e5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.180761 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793b10f-dc10-4e1f-9e62-2938a791e5d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.181380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793b10f-dc10-4e1f-9e62-2938a791e5d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.183303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793b10f-dc10-4e1f-9e62-2938a791e5d0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.212631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2e00ccdd704b6b85832c7210a248d5', 'request_id': 'req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:34.215067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 994/1969] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:34 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:34.220285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793b10f-dc10-4e1f-9e62-2938a791e5d0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.222214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2e00ccdd704b6b85832c7210a248d5', 'request_id': 'req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:34.231155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2e00ccdd704b6b85832c7210a248d5', 'request_id': 'req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:34.244515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] The token cache is being invalidate because project ea2e00ccdd704b6b85832c7210a248d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:34.244809 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:34.245467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-24b43f21-e8f6-4bb4-80a4-ca833b928cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:34.247423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 976/1970] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:34 2022] DELETE /identity/v3/projects/ea2e00ccdd704b6b85832c7210a248d5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:34.253384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026ffe-d16c-44c2-bd77-f7505d680032 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.254647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026ffe-d16c-44c2-bd77-f7505d680032 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.255098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00026ffe-d16c-44c2-bd77-f7505d680032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.268869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:34.279642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-00026ffe-d16c-44c2-bd77-f7505d680032 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:34.281327 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-00026ffe-d16c-44c2-bd77-f7505d680032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:34.291176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793b10f-dc10-4e1f-9e62-2938a791e5d0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.295631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 977/1971] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:34.297560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42d20a-2097-4a7b-b789-21e0220e0dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.298218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42d20a-2097-4a7b-b789-21e0220e0dbf admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.298502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42d20a-2097-4a7b-b789-21e0220e0dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.298778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42d20a-2097-4a7b-b789-21e0220e0dbf admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.299416 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42d20a-2097-4a7b-b789-21e0220e0dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.301883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42d20a-2097-4a7b-b789-21e0220e0dbf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.303933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877bbac-a5fc-4746-95c0-fbf2b63cb85a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.304930 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877bbac-a5fc-4746-95c0-fbf2b63cb85a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.305637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877bbac-a5fc-4746-95c0-fbf2b63cb85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.334146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 995/1972] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:34 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:34.335741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42d20a-2097-4a7b-b789-21e0220e0dbf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.337597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2d42d20a-2097-4a7b-b789-21e0220e0dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:34.338737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8877bbac-a5fc-4746-95c0-fbf2b63cb85a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:34.340024 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8877bbac-a5fc-4746-95c0-fbf2b63cb85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:34.354052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 978/1973] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:34.357557 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42d20a-2097-4a7b-b789-21e0220e0dbf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.359035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877bbac-a5fc-4746-95c0-fbf2b63cb85a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.362678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1554552-37f6-426e-92ad-11d8df85dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.364195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554552-37f6-426e-92ad-11d8df85dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.364541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554552-37f6-426e-92ad-11d8df85dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.365485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554552-37f6-426e-92ad-11d8df85dda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.366014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1554552-37f6-426e-92ad-11d8df85dda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.368403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1554552-37f6-426e-92ad-11d8df85dda7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.372117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877bbac-a5fc-4746-95c0-fbf2b63cb85a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.380273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7c7c9-1e07-46c9-92a7-7e5cf2a5fc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.381072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7c7c9-1e07-46c9-92a7-7e5cf2a5fc4e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.381503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7c7c9-1e07-46c9-92a7-7e5cf2a5fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.381953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7c7c9-1e07-46c9-92a7-7e5cf2a5fc4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.382953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7c7c9-1e07-46c9-92a7-7e5cf2a5fc4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:34.383457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7c7c9-1e07-46c9-92a7-7e5cf2a5fc4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.385276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7c7c9-1e07-46c9-92a7-7e5cf2a5fc4e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.386372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 996/1974] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:34.387283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1554552-37f6-426e-92ad-11d8df85dda7 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.398930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1554552-37f6-426e-92ad-11d8df85dda7 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.402893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 979/1975] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:34.407364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7c7c9-1e07-46c9-92a7-7e5cf2a5fc4e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.412398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee1368-59f9-48b3-9ccd-48c545fb6612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.413160 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee1368-59f9-48b3-9ccd-48c545fb6612 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.413509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee1368-59f9-48b3-9ccd-48c545fb6612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.413856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee1368-59f9-48b3-9ccd-48c545fb6612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.414664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee1368-59f9-48b3-9ccd-48c545fb6612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.417008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee1368-59f9-48b3-9ccd-48c545fb6612 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.422436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7c7c9-1e07-46c9-92a7-7e5cf2a5fc4e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.441504 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811fab-116d-4912-b856-bcd6933e5a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.442329 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811fab-116d-4912-b856-bcd6933e5a90 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.442768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811fab-116d-4912-b856-bcd6933e5a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.443106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811fab-116d-4912-b856-bcd6933e5a90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.446063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 997/1976] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:34.446201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2811fab-116d-4912-b856-bcd6933e5a90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.446201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2811fab-116d-4912-b856-bcd6933e5a90 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.450917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee1368-59f9-48b3-9ccd-48c545fb6612 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.460992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee1368-59f9-48b3-9ccd-48c545fb6612 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.467066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c3c76-7a4b-4c4b-97b9-355b57f38a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.467779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c3c76-7a4b-4c4b-97b9-355b57f38a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.468051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c3c76-7a4b-4c4b-97b9-355b57f38a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.468311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c3c76-7a4b-4c4b-97b9-355b57f38a8f admin admin] PATH_INFO: `/v3/projects/639a64b265474356bc7d0979f770384c/users/9e9f30a5704f4c54a6abd50d10bb097b/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.479848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 980/1977] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:34 2022] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:34.484473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811fab-116d-4912-b856-bcd6933e5a90 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.491735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c3c76-7a4b-4c4b-97b9-355b57f38a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=639a64b265474356bc7d0979f770384c, user_id=9e9f30a5704f4c54a6abd50d10bb097b, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.494523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c3c76-7a4b-4c4b-97b9-355b57f38a8f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.514606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 998/1978] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:34 2022] PUT /identity/v3/projects/639a64b265474356bc7d0979f770384c/users/9e9f30a5704f4c54a6abd50d10bb097b/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:34.523831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049707d-8354-44c0-bd0b-086f76dfaf40 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.524116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049707d-8354-44c0-bd0b-086f76dfaf40 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.524394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049707d-8354-44c0-bd0b-086f76dfaf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.558423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8049707d-8354-44c0-bd0b-086f76dfaf40 None None] MFA Rules not processed for user `9e9f30a5704f4c54a6abd50d10bb097b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:34.559630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8049707d-8354-44c0-bd0b-086f76dfaf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:34.587213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811fab-116d-4912-b856-bcd6933e5a90 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.631877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:34.650472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 999/1979] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:34.654826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049707d-8354-44c0-bd0b-086f76dfaf40 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.667325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5ebf5-6bed-44bf-954b-eb1e7f39de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.667940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5ebf5-6bed-44bf-954b-eb1e7f39de48 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.668225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5ebf5-6bed-44bf-954b-eb1e7f39de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.668500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5ebf5-6bed-44bf-954b-eb1e7f39de48 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.669685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5ebf5-6bed-44bf-954b-eb1e7f39de48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.671957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5ebf5-6bed-44bf-954b-eb1e7f39de48 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.709964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 981/1980] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:34 2022] POST /identity/v3/users => generated 305 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:34.716414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5ebf5-6bed-44bf-954b-eb1e7f39de48 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.731565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5ebf5-6bed-44bf-954b-eb1e7f39de48 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.736640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291ff07-cb7d-4c4f-94b9-65b6b43eef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.737261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291ff07-cb7d-4c4f-94b9-65b6b43eef59 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.737540 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291ff07-cb7d-4c4f-94b9-65b6b43eef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.737817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291ff07-cb7d-4c4f-94b9-65b6b43eef59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.739198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291ff07-cb7d-4c4f-94b9-65b6b43eef59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.741102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291ff07-cb7d-4c4f-94b9-65b6b43eef59 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.754090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 982/1981] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:34.756181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291ff07-cb7d-4c4f-94b9-65b6b43eef59 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.760906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049707d-8354-44c0-bd0b-086f76dfaf40 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.766174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72176d5-58c2-4557-9aca-e62d6deec9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.766794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72176d5-58c2-4557-9aca-e62d6deec9ee admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.767079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72176d5-58c2-4557-9aca-e62d6deec9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.767240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291ff07-cb7d-4c4f-94b9-65b6b43eef59 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.767364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72176d5-58c2-4557-9aca-e62d6deec9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.767971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72176d5-58c2-4557-9aca-e62d6deec9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.770440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72176d5-58c2-4557-9aca-e62d6deec9ee admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.774833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7b390-a75e-4a26-a504-994f8b427a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.775456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7b390-a75e-4a26-a504-994f8b427a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.775741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7b390-a75e-4a26-a504-994f8b427a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.776013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7b390-a75e-4a26-a504-994f8b427a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.776667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7b390-a75e-4a26-a504-994f8b427a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.778336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7b390-a75e-4a26-a504-994f8b427a0b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.789634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 983/1982] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:34.794270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7b390-a75e-4a26-a504-994f8b427a0b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.794453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:34.806276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1000/1983] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:34 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:34.807251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72176d5-58c2-4557-9aca-e62d6deec9ee admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.808773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7b390-a75e-4a26-a504-994f8b427a0b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.865649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fb61e-efce-479f-8157-a1083fa9dcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.866341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb61e-efce-479f-8157-a1083fa9dcd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.866625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb61e-efce-479f-8157-a1083fa9dcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.866902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb61e-efce-479f-8157-a1083fa9dcd0 admin admin] PATH_INFO: `/v3/projects/6a5568d6c3964ab08249fb03c0a32533/users/97cddf67faad42fe96a4d7e9a1dcf286/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.871216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72176d5-58c2-4557-9aca-e62d6deec9ee admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.875987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c95dc-ef79-467f-8e16-3dbcc42a4f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.876675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c95dc-ef79-467f-8e16-3dbcc42a4f39 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.876876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c95dc-ef79-467f-8e16-3dbcc42a4f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.877185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c95dc-ef79-467f-8e16-3dbcc42a4f39 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.877809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c95dc-ef79-467f-8e16-3dbcc42a4f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.879785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c95dc-ef79-467f-8e16-3dbcc42a4f39 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.881512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fb61e-efce-479f-8157-a1083fa9dcd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5568d6c3964ab08249fb03c0a32533, user_id=97cddf67faad42fe96a4d7e9a1dcf286, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.884250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fb61e-efce-479f-8157-a1083fa9dcd0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.899733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 984/1984] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:34 2022] PUT /identity/v3/projects/6a5568d6c3964ab08249fb03c0a32533/users/97cddf67faad42fe96a4d7e9a1dcf286/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:34.901412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1001/1985] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:34 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:34.907342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fb61e-efce-479f-8157-a1083fa9dcd0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:34.911908 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bacc5e-0d0c-4719-83c8-3402913505fa None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.912394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bacc5e-0d0c-4719-83c8-3402913505fa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.912722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bacc5e-0d0c-4719-83c8-3402913505fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.939952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-48bacc5e-0d0c-4719-83c8-3402913505fa None None] MFA Rules not processed for user `97cddf67faad42fe96a4d7e9a1dcf286`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:34.941183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-48bacc5e-0d0c-4719-83c8-3402913505fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:34.968775 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fb61e-efce-479f-8157-a1083fa9dcd0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:34.974424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f5fbb-79df-454c-8233-3088d48c2256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:34.975108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f5fbb-79df-454c-8233-3088d48c2256 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:34.975388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f5fbb-79df-454c-8233-3088d48c2256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:34.975663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f5fbb-79df-454c-8233-3088d48c2256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:34.976618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f5fbb-79df-454c-8233-3088d48c2256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:34.978306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f5fbb-79df-454c-8233-3088d48c2256 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:34.988086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 985/1986] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:34.992202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f5fbb-79df-454c-8233-3088d48c2256 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:35.002430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f5fbb-79df-454c-8233-3088d48c2256 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:35.007034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea243b8-abf3-4691-94fa-28b1c46dc45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:35.007672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea243b8-abf3-4691-94fa-28b1c46dc45a admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.007950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea243b8-abf3-4691-94fa-28b1c46dc45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.008250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea243b8-abf3-4691-94fa-28b1c46dc45a admin admin] PATH_INFO: `/v3/projects/05d9deb6a6784666a3efa53928b06438/users/7e64bff0a8414cc5b0d316b8fb1bc6e0/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.009372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1002/1987] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:34 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:35.013885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bacc5e-0d0c-4719-83c8-3402913505fa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:35.024595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bacc5e-0d0c-4719-83c8-3402913505fa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:35.025836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea243b8-abf3-4691-94fa-28b1c46dc45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d9deb6a6784666a3efa53928b06438, user_id=7e64bff0a8414cc5b0d316b8fb1bc6e0, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:35.028588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea243b8-abf3-4691-94fa-28b1c46dc45a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:35.029264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61a34d-be76-4aa7-a704-de37fdd88755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:35.029858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a34d-be76-4aa7-a704-de37fdd88755 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.030181 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a34d-be76-4aa7-a704-de37fdd88755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.030458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a34d-be76-4aa7-a704-de37fdd88755 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.031079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61a34d-be76-4aa7-a704-de37fdd88755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:35.031618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:35.033320 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61a34d-be76-4aa7-a704-de37fdd88755 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:35.051455 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 986/1988] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:34 2022] PUT /identity/v3/projects/05d9deb6a6784666a3efa53928b06438/users/7e64bff0a8414cc5b0d316b8fb1bc6e0/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:35.055375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea243b8-abf3-4691-94fa-28b1c46dc45a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:35.073378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1003/1989] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:35 2022] POST /identity/v3/projects => generated 409 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:35.078729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61a34d-be76-4aa7-a704-de37fdd88755 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:35.133725 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea243b8-abf3-4691-94fa-28b1c46dc45a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:35.188959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:35.195365 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61a34d-be76-4aa7-a704-de37fdd88755 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:35.202729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907020a2-4eec-4e24-9819-dc4b0ca35e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:35.203394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907020a2-4eec-4e24-9819-dc4b0ca35e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.203659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907020a2-4eec-4e24-9819-dc4b0ca35e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.203945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907020a2-4eec-4e24-9819-dc4b0ca35e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.204603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907020a2-4eec-4e24-9819-dc4b0ca35e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:35.206250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907020a2-4eec-4e24-9819-dc4b0ca35e9b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:35.210086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713633f8-2c33-4406-82f2-272bdfb18fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:35.210714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713633f8-2c33-4406-82f2-272bdfb18fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.210998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713633f8-2c33-4406-82f2-272bdfb18fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.211271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713633f8-2c33-4406-82f2-272bdfb18fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.211971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713633f8-2c33-4406-82f2-272bdfb18fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:35.213885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713633f8-2c33-4406-82f2-272bdfb18fb0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:35.221396 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 987/1990] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:35.227068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907020a2-4eec-4e24-9819-dc4b0ca35e9b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:35.239758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907020a2-4eec-4e24-9819-dc4b0ca35e9b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:35.240284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1004/1991] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:35 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:35.244358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713633f8-2c33-4406-82f2-272bdfb18fb0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:35.247627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986476e-a40f-42ab-bef9-435ace42bf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:35.248310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986476e-a40f-42ab-bef9-435ace42bf12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.248737 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986476e-a40f-42ab-bef9-435ace42bf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.248836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986476e-a40f-42ab-bef9-435ace42bf12 admin admin] PATH_INFO: `/v3/projects/05d9deb6a6784666a3efa53928b06438/users/7e64bff0a8414cc5b0d316b8fb1bc6e0/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.251124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986476e-a40f-42ab-bef9-435ace42bf12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d9deb6a6784666a3efa53928b06438, user_id=7e64bff0a8414cc5b0d316b8fb1bc6e0, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:35.255207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986476e-a40f-42ab-bef9-435ace42bf12 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:35.256764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713633f8-2c33-4406-82f2-272bdfb18fb0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:35.262193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f8e27-8c8c-466d-9c0c-efc2404e5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:35.262807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f8e27-8c8c-466d-9c0c-efc2404e5ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.263231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f8e27-8c8c-466d-9c0c-efc2404e5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.263503 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f8e27-8c8c-466d-9c0c-efc2404e5ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.264169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f8e27-8c8c-466d-9c0c-efc2404e5ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:35.265954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f8e27-8c8c-466d-9c0c-efc2404e5ce4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:35.266881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 988/1992] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:35 2022] PUT /identity/v3/projects/05d9deb6a6784666a3efa53928b06438/users/7e64bff0a8414cc5b0d316b8fb1bc6e0/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:35.282101 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1005/1993] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:35.286294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c2488-6961-4bc8-9f00-839fc62375b5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.286776 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c2488-6961-4bc8-9f00-839fc62375b5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.287112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c2488-6961-4bc8-9f00-839fc62375b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.290501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f8e27-8c8c-466d-9c0c-efc2404e5ce4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:35.301279 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f8e27-8c8c-466d-9c0c-efc2404e5ce4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:35.318671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e38c2488-6961-4bc8-9f00-839fc62375b5 None None] MFA Rules not processed for user `7e64bff0a8414cc5b0d316b8fb1bc6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:35.319879 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e38c2488-6961-4bc8-9f00-839fc62375b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:35.364887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0473685-8b9d-4347-91f3-b5be22c37492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:35.365702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0473685-8b9d-4347-91f3-b5be22c37492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.366098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0473685-8b9d-4347-91f3-b5be22c37492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.366383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0473685-8b9d-4347-91f3-b5be22c37492 admin admin] PATH_INFO: `/v3/projects/08c315d9181f466fa757eee66fd1f4c3/users/3acf930f61aa46809af34feaa52bbb19/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.382308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0473685-8b9d-4347-91f3-b5be22c37492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c315d9181f466fa757eee66fd1f4c3, user_id=3acf930f61aa46809af34feaa52bbb19, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:35.385011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0473685-8b9d-4347-91f3-b5be22c37492 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:35.399200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 989/1994] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:35.402968 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1006/1995] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:35 2022] PUT /identity/v3/projects/08c315d9181f466fa757eee66fd1f4c3/users/3acf930f61aa46809af34feaa52bbb19/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:35.404231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c2488-6961-4bc8-9f00-839fc62375b5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:35.410820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0473685-8b9d-4347-91f3-b5be22c37492 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:35.412620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d0473685-8b9d-4347-91f3-b5be22c37492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:35.415567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c2488-6961-4bc8-9f00-839fc62375b5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:35.425493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:35.479458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0473685-8b9d-4347-91f3-b5be22c37492 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:35.483897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaf527-e4e4-4628-97f0-09e63767b71a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:35.486073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaf527-e4e4-4628-97f0-09e63767b71a service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.486073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaf527-e4e4-4628-97f0-09e63767b71a service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.486073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaf527-e4e4-4628-97f0-09e63767b71a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.501848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8661a-1253-44b8-be82-16819fd49ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:35.502489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8661a-1253-44b8-be82-16819fd49ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.502767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8661a-1253-44b8-be82-16819fd49ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.503037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8661a-1253-44b8-be82-16819fd49ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.503736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8661a-1253-44b8-be82-16819fd49ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:35.505842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8661a-1253-44b8-be82-16819fd49ebe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:35.519550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 990/1996] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:35.521782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8661a-1253-44b8-be82-16819fd49ebe admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:35.534307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8661a-1253-44b8-be82-16819fd49ebe admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:35.540277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bf79c-64c6-4643-96fa-55c83d608eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:35.541076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bf79c-64c6-4643-96fa-55c83d608eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.541390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bf79c-64c6-4643-96fa-55c83d608eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.541667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bf79c-64c6-4643-96fa-55c83d608eaf admin admin] PATH_INFO: `/v3/projects/08c315d9181f466fa757eee66fd1f4c3/users/3acf930f61aa46809af34feaa52bbb19/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.543690 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bf79c-64c6-4643-96fa-55c83d608eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c315d9181f466fa757eee66fd1f4c3, user_id=3acf930f61aa46809af34feaa52bbb19, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:35.546657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bf79c-64c6-4643-96fa-55c83d608eaf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:35.558624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 991/1997] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:35 2022] PUT /identity/v3/projects/08c315d9181f466fa757eee66fd1f4c3/users/3acf930f61aa46809af34feaa52bbb19/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:35.569326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dae7c4-3a08-4299-8a94-e893e52e13d6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.569665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dae7c4-3a08-4299-8a94-e893e52e13d6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.569892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dae7c4-3a08-4299-8a94-e893e52e13d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.572002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaf527-e4e4-4628-97f0-09e63767b71a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:35.573476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaf527-e4e4-4628-97f0-09e63767b71a service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:35.584424 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1007/1998] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:35.600192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-19dae7c4-3a08-4299-8a94-e893e52e13d6 None None] MFA Rules not processed for user `3acf930f61aa46809af34feaa52bbb19`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:35.602892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-19dae7c4-3a08-4299-8a94-e893e52e13d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:35.681953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 992/1999] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:35 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:35.695485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaf527-e4e4-4628-97f0-09e63767b71a service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:35.697177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3afaf527-e4e4-4628-97f0-09e63767b71a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:35.710702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaf527-e4e4-4628-97f0-09e63767b71a service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:35.715870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:35.781067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae9968-6073-41cd-a027-b7f9f9391fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:35.781612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae9968-6073-41cd-a027-b7f9f9391fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:35.781889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae9968-6073-41cd-a027-b7f9f9391fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:35.782190 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae9968-6073-41cd-a027-b7f9f9391fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:35.793086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae9968-6073-41cd-a027-b7f9f9391fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:35.794582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cae9968-6073-41cd-a027-b7f9f9391fd5 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:35.805721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1008/2000] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:35 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:36.058266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dae7c4-3a08-4299-8a94-e893e52e13d6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:36.068741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dae7c4-3a08-4299-8a94-e893e52e13d6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:36.073198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b56c6-57bb-4112-ac01-26ca40af3762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:36.073848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b56c6-57bb-4112-ac01-26ca40af3762 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:36.074231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b56c6-57bb-4112-ac01-26ca40af3762 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:36.074516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b56c6-57bb-4112-ac01-26ca40af3762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:36.153457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b56c6-57bb-4112-ac01-26ca40af3762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:36.154954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b56c6-57bb-4112-ac01-26ca40af3762 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:36.165894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 993/2001] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:36 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:37.510853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae9968-6073-41cd-a027-b7f9f9391fd5 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:37.600787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae9968-6073-41cd-a027-b7f9f9391fd5 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:37.605723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:37.606395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:37.606680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:37.606956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] PATH_INFO: `/v3/users/9e9f30a5704f4c54a6abd50d10bb097b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:37.611459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9f30a5704f4c54a6abd50d10bb097b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:37.613911 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:37.685397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9f30a5704f4c54a6abd50d10bb097b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:37.692915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9f30a5704f4c54a6abd50d10bb097b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:37.708764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9f30a5704f4c54a6abd50d10bb097b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:37.722907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9f30a5704f4c54a6abd50d10bb097b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:37.723844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9f30a5704f4c54a6abd50d10bb097b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:37.736676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1009/2002] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:37 2022] DELETE /identity/v3/users/9e9f30a5704f4c54a6abd50d10bb097b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:37.739014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452d431-6efd-47d4-9e39-23728c3fbb78 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:37.739484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452d431-6efd-47d4-9e39-23728c3fbb78 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:37.739573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452d431-6efd-47d4-9e39-23728c3fbb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:37.762013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1452d431-6efd-47d4-9e39-23728c3fbb78 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:37.763277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1452d431-6efd-47d4-9e39-23728c3fbb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:37.780012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:37.853872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 994/2003] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:37.866559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:37.867992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:37.905695 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:37.946008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00ac18-e64c-4e81-8c73-1ad511408cf5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:37.950594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e46e61-8cf5-40cf-95d7-36d7d06eeaca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:37.951164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e46e61-8cf5-40cf-95d7-36d7d06eeaca service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:37.951444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e46e61-8cf5-40cf-95d7-36d7d06eeaca service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:37.951778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e46e61-8cf5-40cf-95d7-36d7d06eeaca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:37.962148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e46e61-8cf5-40cf-95d7-36d7d06eeaca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:37.963599 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e46e61-8cf5-40cf-95d7-36d7d06eeaca service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:37.973568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1010/2004] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:38.250829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452d431-6efd-47d4-9e39-23728c3fbb78 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:38.252435 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1452d431-6efd-47d4-9e39-23728c3fbb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:38.264729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452d431-6efd-47d4-9e39-23728c3fbb78 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:38.269833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:38.270613 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:38.270900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:38.271226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] PATH_INFO: `/v3/projects/639a64b265474356bc7d0979f770384c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:38.273277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=639a64b265474356bc7d0979f770384c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:38.275364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:38.323877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639a64b265474356bc7d0979f770384c', 'request_id': 'req-a01673a3-9f56-461a-bf42-c207d742b492'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:38.329243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639a64b265474356bc7d0979f770384c', 'request_id': 'req-a01673a3-9f56-461a-bf42-c207d742b492'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:38.336167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639a64b265474356bc7d0979f770384c', 'request_id': 'req-a01673a3-9f56-461a-bf42-c207d742b492'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:38.347107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] The token cache is being invalidate because project 639a64b265474356bc7d0979f770384c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:38.347927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:38.348870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:38.350321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 995/2005] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:38 2022] DELETE /identity/v3/projects/639a64b265474356bc7d0979f770384c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:38.354382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e46e61-8cf5-40cf-95d7-36d7d06eeaca service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:38.364667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e46e61-8cf5-40cf-95d7-36d7d06eeaca service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:38.419985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea857e26-56e0-4613-9472-a4264d853f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:38.420618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea857e26-56e0-4613-9472-a4264d853f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:38.420903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea857e26-56e0-4613-9472-a4264d853f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:38.421177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea857e26-56e0-4613-9472-a4264d853f0e admin admin] PATH_INFO: `/v3/users/7e64bff0a8414cc5b0d316b8fb1bc6e0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:38.422339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea857e26-56e0-4613-9472-a4264d853f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e64bff0a8414cc5b0d316b8fb1bc6e0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:38.424280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea857e26-56e0-4613-9472-a4264d853f0e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:38.470843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ea857e26-56e0-4613-9472-a4264d853f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e64bff0a8414cc5b0d316b8fb1bc6e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:38.479421 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ea857e26-56e0-4613-9472-a4264d853f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e64bff0a8414cc5b0d316b8fb1bc6e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:38.492483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ea857e26-56e0-4613-9472-a4264d853f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e64bff0a8414cc5b0d316b8fb1bc6e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:38.500436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ea857e26-56e0-4613-9472-a4264d853f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e64bff0a8414cc5b0d316b8fb1bc6e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:38.501183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ea857e26-56e0-4613-9472-a4264d853f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e64bff0a8414cc5b0d316b8fb1bc6e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:38.509575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1011/2006] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:38 2022] DELETE /identity/v3/users/7e64bff0a8414cc5b0d316b8fb1bc6e0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:38.884584 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:38.886865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:38.915268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01673a3-9f56-461a-bf42-c207d742b492 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:39.033827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:39.033827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:39.033827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:39.033827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] PATH_INFO: `/v3/projects/05d9deb6a6784666a3efa53928b06438` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:39.034384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d9deb6a6784666a3efa53928b06438)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:39.034384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:39.099430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:39.106654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d9deb6a6784666a3efa53928b06438', 'request_id': 'req-7c9dcaba-dced-429b-8ee7-456cba08fbec'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:39.114618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d9deb6a6784666a3efa53928b06438', 'request_id': 'req-7c9dcaba-dced-429b-8ee7-456cba08fbec'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:39.139234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d9deb6a6784666a3efa53928b06438', 'request_id': 'req-7c9dcaba-dced-429b-8ee7-456cba08fbec'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:39.158354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] The token cache is being invalidate because project 05d9deb6a6784666a3efa53928b06438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:39.158978 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:39.160434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c9dcaba-dced-429b-8ee7-456cba08fbec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:39.163542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 996/2007] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:38 2022] DELETE /identity/v3/projects/05d9deb6a6784666a3efa53928b06438 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:39.168483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cde4-a0f8-4b9e-9992-e0fc30ba242b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:39.169315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cde4-a0f8-4b9e-9992-e0fc30ba242b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:39.169632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cde4-a0f8-4b9e-9992-e0fc30ba242b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:39.191639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4b19cde4-a0f8-4b9e-9992-e0fc30ba242b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:39.192885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4b19cde4-a0f8-4b9e-9992-e0fc30ba242b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:39.266593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:39.290595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1012/2008] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:39.298147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078aa1e-8434-405e-a29a-1652dc94e842 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:39.298443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078aa1e-8434-405e-a29a-1652dc94e842 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:39.298724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078aa1e-8434-405e-a29a-1652dc94e842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:39.332898 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5078aa1e-8434-405e-a29a-1652dc94e842 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:39.334486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5078aa1e-8434-405e-a29a-1652dc94e842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:39.350498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 997/2009] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:39.354993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19cde4-a0f8-4b9e-9992-e0fc30ba242b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:39.376155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19cde4-a0f8-4b9e-9992-e0fc30ba242b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:39.381943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3e38-7683-4882-b3dd-d7bf40f83939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:39.382692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3e38-7683-4882-b3dd-d7bf40f83939 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:39.383078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3e38-7683-4882-b3dd-d7bf40f83939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:39.383328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3e38-7683-4882-b3dd-d7bf40f83939 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:39.384157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3e38-7683-4882-b3dd-d7bf40f83939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:39.384412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3e38-7683-4882-b3dd-d7bf40f83939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:39.386444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3e38-7683-4882-b3dd-d7bf40f83939 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:39.401420 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1013/2010] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:23:39.405441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078aa1e-8434-405e-a29a-1652dc94e842 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:39.419084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078aa1e-8434-405e-a29a-1652dc94e842 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:39.425962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d339eb-3323-4a62-b6e2-aac97b568d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:39.426957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d339eb-3323-4a62-b6e2-aac97b568d22 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:39.427322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d339eb-3323-4a62-b6e2-aac97b568d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:39.427715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d339eb-3323-4a62-b6e2-aac97b568d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:39.428503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d339eb-3323-4a62-b6e2-aac97b568d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:39.431146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d339eb-3323-4a62-b6e2-aac97b568d22 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:39.474673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 998/2011] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:39 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:39.481009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3e38-7683-4882-b3dd-d7bf40f83939 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:39.492569 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3e38-7683-4882-b3dd-d7bf40f83939 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:39.603015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5fc27-aa1b-4f72-aa03-6fbb6d625cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:39.603665 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5fc27-aa1b-4f72-aa03-6fbb6d625cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:39.603977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5fc27-aa1b-4f72-aa03-6fbb6d625cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:39.604255 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c5fc27-aa1b-4f72-aa03-6fbb6d625cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:39.614106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5fc27-aa1b-4f72-aa03-6fbb6d625cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:39.615901 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c5fc27-aa1b-4f72-aa03-6fbb6d625cd4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:39.650182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1014/2012] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:39 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:39.654939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d339eb-3323-4a62-b6e2-aac97b568d22 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:39.676434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d339eb-3323-4a62-b6e2-aac97b568d22 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:39.684368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b0fa5-e57c-4e25-9aa8-2de375a67fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:39.685728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0fa5-e57c-4e25-9aa8-2de375a67fdd admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:39.686222 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0fa5-e57c-4e25-9aa8-2de375a67fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:39.686549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0fa5-e57c-4e25-9aa8-2de375a67fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:39.687209 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b0fa5-e57c-4e25-9aa8-2de375a67fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:39.689135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b0fa5-e57c-4e25-9aa8-2de375a67fdd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:39.702427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 999/2013] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:39.707680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5fc27-aa1b-4f72-aa03-6fbb6d625cd4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:39.720017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c5fc27-aa1b-4f72-aa03-6fbb6d625cd4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:39.733766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fd4f0-6ec2-41a2-94da-9b29b6e94d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:39.734737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fd4f0-6ec2-41a2-94da-9b29b6e94d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:39.735378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fd4f0-6ec2-41a2-94da-9b29b6e94d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:39.736039 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fd4f0-6ec2-41a2-94da-9b29b6e94d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:39.736839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fd4f0-6ec2-41a2-94da-9b29b6e94d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:39.744370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fd4f0-6ec2-41a2-94da-9b29b6e94d9a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:39.777915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1015/2014] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:39.789467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b0fa5-e57c-4e25-9aa8-2de375a67fdd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:39.801866 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b0fa5-e57c-4e25-9aa8-2de375a67fdd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:39.807103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6064f6e-23d5-47bc-ba01-f0b1d97bf051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:39.807956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6064f6e-23d5-47bc-ba01-f0b1d97bf051 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:39.808238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6064f6e-23d5-47bc-ba01-f0b1d97bf051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:39.808517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6064f6e-23d5-47bc-ba01-f0b1d97bf051 admin admin] PATH_INFO: `/v3/projects/07390fea5fa44e75aca7610d6f4b09b5/users/0b6945ffb82b4a77862568623d8bff18/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:39.824274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6064f6e-23d5-47bc-ba01-f0b1d97bf051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07390fea5fa44e75aca7610d6f4b09b5, user_id=0b6945ffb82b4a77862568623d8bff18, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:39.826991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6064f6e-23d5-47bc-ba01-f0b1d97bf051 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:39.839398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1000/2015] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:39 2022] PUT /identity/v3/projects/07390fea5fa44e75aca7610d6f4b09b5/users/0b6945ffb82b4a77862568623d8bff18/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:39.851617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e915052-6380-4dfa-964c-e63bdc1b3cc6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:39.851906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e915052-6380-4dfa-964c-e63bdc1b3cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:39.852185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e915052-6380-4dfa-964c-e63bdc1b3cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:39.880239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6e915052-6380-4dfa-964c-e63bdc1b3cc6 None None] MFA Rules not processed for user `0b6945ffb82b4a77862568623d8bff18`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:39.881509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6e915052-6380-4dfa-964c-e63bdc1b3cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:39.947680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1016/2016] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:39.952223 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6064f6e-23d5-47bc-ba01-f0b1d97bf051 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:40.023049 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6064f6e-23d5-47bc-ba01-f0b1d97bf051 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:40.028515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bdb6d-739a-46e3-808a-489a23291611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:40.029353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bdb6d-739a-46e3-808a-489a23291611 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:40.029640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bdb6d-739a-46e3-808a-489a23291611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:40.029918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bdb6d-739a-46e3-808a-489a23291611 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:40.030598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bdb6d-739a-46e3-808a-489a23291611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:40.032511 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bdb6d-739a-46e3-808a-489a23291611 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:40.061410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1001/2017] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:39 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:40.065575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e915052-6380-4dfa-964c-e63bdc1b3cc6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:40.076601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e915052-6380-4dfa-964c-e63bdc1b3cc6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:40.122834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:40.135875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce0c77-886d-4d21-b431-48c4d549a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:40.136496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce0c77-886d-4d21-b431-48c4d549a0dc admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:40.136778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce0c77-886d-4d21-b431-48c4d549a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:40.137052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce0c77-886d-4d21-b431-48c4d549a0dc admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:40.137678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce0c77-886d-4d21-b431-48c4d549a0dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:40.139618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce0c77-886d-4d21-b431-48c4d549a0dc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:40.162485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1017/2018] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:40 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:40.167276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bdb6d-739a-46e3-808a-489a23291611 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:40.178084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bdb6d-739a-46e3-808a-489a23291611 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:40.182898 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772cf08-d78f-4ff3-8011-c7abb8159baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:40.183507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772cf08-d78f-4ff3-8011-c7abb8159baf admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:40.183792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772cf08-d78f-4ff3-8011-c7abb8159baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:40.184072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772cf08-d78f-4ff3-8011-c7abb8159baf admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:40.184732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772cf08-d78f-4ff3-8011-c7abb8159baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:40.186354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772cf08-d78f-4ff3-8011-c7abb8159baf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:40.198125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1002/2019] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:40.202147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce0c77-886d-4d21-b431-48c4d549a0dc admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:40.213863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce0c77-886d-4d21-b431-48c4d549a0dc admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:40.218936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc219fa3-5ce4-49d3-8be0-b1dfc7967285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:40.219614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc219fa3-5ce4-49d3-8be0-b1dfc7967285 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:40.219898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc219fa3-5ce4-49d3-8be0-b1dfc7967285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:40.220208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc219fa3-5ce4-49d3-8be0-b1dfc7967285 admin admin] PATH_INFO: `/v3/projects/bd5b3f6b257247699c6a857697eaee28/users/4326e62c0a344c059172aea43c0bdf52/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:40.236677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc219fa3-5ce4-49d3-8be0-b1dfc7967285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5b3f6b257247699c6a857697eaee28, user_id=4326e62c0a344c059172aea43c0bdf52, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:40.239603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc219fa3-5ce4-49d3-8be0-b1dfc7967285 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:40.255326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1018/2020] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:40 2022] PUT /identity/v3/projects/bd5b3f6b257247699c6a857697eaee28/users/4326e62c0a344c059172aea43c0bdf52/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:40.258828 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772cf08-d78f-4ff3-8011-c7abb8159baf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:40.275137 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772cf08-d78f-4ff3-8011-c7abb8159baf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:40.276621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc219fa3-5ce4-49d3-8be0-b1dfc7967285 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:40.278792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fc219fa3-5ce4-49d3-8be0-b1dfc7967285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:40.333823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:40.353497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cacc09-aeac-468f-92fd-306dd60730a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:40.354153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacc09-aeac-468f-92fd-306dd60730a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:40.354440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacc09-aeac-468f-92fd-306dd60730a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:40.354713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cacc09-aeac-468f-92fd-306dd60730a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:40.355393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cacc09-aeac-468f-92fd-306dd60730a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:40.357159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cacc09-aeac-468f-92fd-306dd60730a0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:40.366095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc219fa3-5ce4-49d3-8be0-b1dfc7967285 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:40.368534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1003/2021] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:40.371185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:40.371825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:40.372104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:40.372378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] PATH_INFO: `/v3/users/2fb553c5747c4878ad4545b4beaaf6cb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:40.372526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cacc09-aeac-468f-92fd-306dd60730a0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:40.373538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb553c5747c4878ad4545b4beaaf6cb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:40.376032 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:40.383429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cacc09-aeac-468f-92fd-306dd60730a0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:40.388409 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8255f1-65e4-4c51-b60f-ce6bf4e0d5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:40.389136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8255f1-65e4-4c51-b60f-ce6bf4e0d5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:40.389502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8255f1-65e4-4c51-b60f-ce6bf4e0d5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:40.389842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8255f1-65e4-4c51-b60f-ce6bf4e0d5fe admin admin] PATH_INFO: `/v3/projects/bd5b3f6b257247699c6a857697eaee28/users/4326e62c0a344c059172aea43c0bdf52/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:40.391870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8255f1-65e4-4c51-b60f-ce6bf4e0d5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd5b3f6b257247699c6a857697eaee28, user_id=4326e62c0a344c059172aea43c0bdf52, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:40.394663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8255f1-65e4-4c51-b60f-ce6bf4e0d5fe admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:40.407531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1004/2022] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:40 2022] PUT /identity/v3/projects/bd5b3f6b257247699c6a857697eaee28/users/4326e62c0a344c059172aea43c0bdf52/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:40.417752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1a42-c51c-4d4a-beb6-f4d0fede00b3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:40.417963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1a42-c51c-4d4a-beb6-f4d0fede00b3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:40.418433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb1a42-c51c-4d4a-beb6-f4d0fede00b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:40.429455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb553c5747c4878ad4545b4beaaf6cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:40.437132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb553c5747c4878ad4545b4beaaf6cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:40.449325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-35fb1a42-c51c-4d4a-beb6-f4d0fede00b3 None None] MFA Rules not processed for user `4326e62c0a344c059172aea43c0bdf52`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:40.450730 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-35fb1a42-c51c-4d4a-beb6-f4d0fede00b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:40.451313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb553c5747c4878ad4545b4beaaf6cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:40.459058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb553c5747c4878ad4545b4beaaf6cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:40.459718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb553c5747c4878ad4545b4beaaf6cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:40.468882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1019/2023] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:40 2022] DELETE /identity/v3/users/2fb553c5747c4878ad4545b4beaaf6cb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:40.546307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1005/2024] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:40.559588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:40.561139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:40.612700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:40.636143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7631c-8d87-44ea-932b-50bb19c29110 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:40.640345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e50ba-feb9-46a1-8d8c-ec4013f18ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:40.640811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e50ba-feb9-46a1-8d8c-ec4013f18ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:40.641086 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e50ba-feb9-46a1-8d8c-ec4013f18ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:40.641366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e50ba-feb9-46a1-8d8c-ec4013f18ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:40.704956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb1a42-c51c-4d4a-beb6-f4d0fede00b3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:40.706526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-35fb1a42-c51c-4d4a-beb6-f4d0fede00b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:40.740101 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e50ba-feb9-46a1-8d8c-ec4013f18ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:40.742706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e50ba-feb9-46a1-8d8c-ec4013f18ae8 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:40.757132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1020/2025] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:40.791595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e50ba-feb9-46a1-8d8c-ec4013f18ae8 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:40.795034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be7e50ba-feb9-46a1-8d8c-ec4013f18ae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:40.799654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb1a42-c51c-4d4a-beb6-f4d0fede00b3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:40.881137 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:40.888538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:40.889415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:40.889854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:40.890333 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] PATH_INFO: `/v3/projects/d397f439d7f6488eab0bc0f8f29a1664` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:40.891583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d397f439d7f6488eab0bc0f8f29a1664)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:40.893661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:40.910357 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e50ba-feb9-46a1-8d8c-ec4013f18ae8 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:40.922833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe17ef-ea70-416d-87f4-bed2f11f4098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:40.924303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe17ef-ea70-416d-87f4-bed2f11f4098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:40.924815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe17ef-ea70-416d-87f4-bed2f11f4098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:40.925300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe17ef-ea70-416d-87f4-bed2f11f4098 admin admin] PATH_INFO: `/v3/users/0b6945ffb82b4a77862568623d8bff18` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:40.927373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe17ef-ea70-416d-87f4-bed2f11f4098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6945ffb82b4a77862568623d8bff18)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:40.930097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe17ef-ea70-416d-87f4-bed2f11f4098 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:40.971715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd397f439d7f6488eab0bc0f8f29a1664', 'request_id': 'req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:40.979913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd397f439d7f6488eab0bc0f8f29a1664', 'request_id': 'req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:40.990872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd397f439d7f6488eab0bc0f8f29a1664', 'request_id': 'req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.004164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] The token cache is being invalidate because project d397f439d7f6488eab0bc0f8f29a1664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:41.004947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.005461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.009788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1006/2026] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:40 2022] DELETE /identity/v3/projects/d397f439d7f6488eab0bc0f8f29a1664 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:41.010663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8efe17ef-ea70-416d-87f4-bed2f11f4098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6945ffb82b4a77862568623d8bff18'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.011171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:41.012979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:41.024671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8efe17ef-ea70-416d-87f4-bed2f11f4098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6945ffb82b4a77862568623d8bff18'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.047050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8efe17ef-ea70-416d-87f4-bed2f11f4098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6945ffb82b4a77862568623d8bff18'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.058589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8efe17ef-ea70-416d-87f4-bed2f11f4098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6945ffb82b4a77862568623d8bff18'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.059303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-8efe17ef-ea70-416d-87f4-bed2f11f4098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6945ffb82b4a77862568623d8bff18'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.067480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1021/2027] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:40 2022] DELETE /identity/v3/users/0b6945ffb82b4a77862568623d8bff18 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:41.072540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d804-601b-4325-9c6b-404cd299e4a6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:41.072824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d804-601b-4325-9c6b-404cd299e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:41.073097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46d804-601b-4325-9c6b-404cd299e4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:41.081350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:41.095809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7f46d804-601b-4325-9c6b-404cd299e4a6 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:41.099292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7f46d804-601b-4325-9c6b-404cd299e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:41.105019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac8bbb-7c3d-4308-87b0-bac6b22e3020 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:41.169863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:41.170473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:41.170753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:41.171027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] PATH_INFO: `/v3/users/717e02bd761d4116a2b2c40a90c73847` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:41.172163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=717e02bd761d4116a2b2c40a90c73847)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:41.174215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:41.177330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1022/2028] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:41.186954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46d804-601b-4325-9c6b-404cd299e4a6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:41.190751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7f46d804-601b-4325-9c6b-404cd299e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:41.222856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:41.234547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717e02bd761d4116a2b2c40a90c73847'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.235255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717e02bd761d4116a2b2c40a90c73847'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.235940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717e02bd761d4116a2b2c40a90c73847'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.250174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717e02bd761d4116a2b2c40a90c73847'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.256999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46d804-601b-4325-9c6b-404cd299e4a6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:41.260712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717e02bd761d4116a2b2c40a90c73847'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.261677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf27e4-f52a-4fb8-9446-3fc091155f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:41.262333 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf27e4-f52a-4fb8-9446-3fc091155f99 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:41.262616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf27e4-f52a-4fb8-9446-3fc091155f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:41.262875 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf27e4-f52a-4fb8-9446-3fc091155f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:41.267472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-05bf27e4-f52a-4fb8-9446-3fc091155f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:41.278798 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf27e4-f52a-4fb8-9446-3fc091155f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:41.280241 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf27e4-f52a-4fb8-9446-3fc091155f99 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:41.287110 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1007/2029] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:41 2022] DELETE /identity/v3/users/717e02bd761d4116a2b2c40a90c73847 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:41.295422 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1023/2030] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:41.608528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:41.611994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:41.720685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77433a-67e2-457a-a4d8-38f93ea68623 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:41.728240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf27e4-f52a-4fb8-9446-3fc091155f99 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:41.730420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:41.730564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-05bf27e4-f52a-4fb8-9446-3fc091155f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:41.731405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:41.731892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:41.732327 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] PATH_INFO: `/v3/projects/38556783e5284bc2afa5e11db73ad5f9` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:41.733649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38556783e5284bc2afa5e11db73ad5f9)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:41.735792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:41.745370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf27e4-f52a-4fb8-9446-3fc091155f99 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:41.751608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:41.753050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:41.754308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:41.754853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] PATH_INFO: `/v3/projects/07390fea5fa44e75aca7610d6f4b09b5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:41.756167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07390fea5fa44e75aca7610d6f4b09b5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:41.759116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:41.824794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07390fea5fa44e75aca7610d6f4b09b5', 'request_id': 'req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.830672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38556783e5284bc2afa5e11db73ad5f9', 'request_id': 'req-4db5493e-2e00-40ac-9068-9f149c7fee72'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.834747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07390fea5fa44e75aca7610d6f4b09b5', 'request_id': 'req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.837488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38556783e5284bc2afa5e11db73ad5f9', 'request_id': 'req-4db5493e-2e00-40ac-9068-9f149c7fee72'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.844585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07390fea5fa44e75aca7610d6f4b09b5', 'request_id': 'req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.848754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38556783e5284bc2afa5e11db73ad5f9', 'request_id': 'req-4db5493e-2e00-40ac-9068-9f149c7fee72'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.859906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] The token cache is being invalidate because project 07390fea5fa44e75aca7610d6f4b09b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:41.860207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.860952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.863278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] The token cache is being invalidate because project 38556783e5284bc2afa5e11db73ad5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:41.863633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1024/2031] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:41 2022] DELETE /identity/v3/projects/07390fea5fa44e75aca7610d6f4b09b5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:41.864375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:41.865683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:41.866457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.867269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:41.869045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1008/2032] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:41 2022] DELETE /identity/v3/projects/38556783e5284bc2afa5e11db73ad5f9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:41.869998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:41.871377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:41.906817 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:41.936586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:41.948444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e4cf7-e434-4e19-b18a-0de47f6b529e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:41.959566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5493e-2e00-40ac-9068-9f149c7fee72 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:41.965519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986ee8a-aea7-44b6-a5d7-bbf0f8dad833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:41.966447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986ee8a-aea7-44b6-a5d7-bbf0f8dad833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:41.966803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986ee8a-aea7-44b6-a5d7-bbf0f8dad833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:41.967139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986ee8a-aea7-44b6-a5d7-bbf0f8dad833 admin admin] PATH_INFO: `/v3/users/4326e62c0a344c059172aea43c0bdf52` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:41.970493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986ee8a-aea7-44b6-a5d7-bbf0f8dad833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4326e62c0a344c059172aea43c0bdf52)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:41.970637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986ee8a-aea7-44b6-a5d7-bbf0f8dad833 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:42.013861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f345d7-e7f8-49cd-bcce-1cf81d90935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:42.014990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f345d7-e7f8-49cd-bcce-1cf81d90935c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.015491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f345d7-e7f8-49cd-bcce-1cf81d90935c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.015997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f345d7-e7f8-49cd-bcce-1cf81d90935c admin admin] PATH_INFO: `/v3/users/97cddf67faad42fe96a4d7e9a1dcf286` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.017965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f345d7-e7f8-49cd-bcce-1cf81d90935c admin admin] RBAC: Authorizing `identity:delete_user(user_id=97cddf67faad42fe96a4d7e9a1dcf286)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:42.021874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f345d7-e7f8-49cd-bcce-1cf81d90935c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:42.027967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c986ee8a-aea7-44b6-a5d7-bbf0f8dad833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4326e62c0a344c059172aea43c0bdf52'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.028720 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c986ee8a-aea7-44b6-a5d7-bbf0f8dad833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4326e62c0a344c059172aea43c0bdf52'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.029360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c986ee8a-aea7-44b6-a5d7-bbf0f8dad833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4326e62c0a344c059172aea43c0bdf52'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.037858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c986ee8a-aea7-44b6-a5d7-bbf0f8dad833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4326e62c0a344c059172aea43c0bdf52'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.045151 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c986ee8a-aea7-44b6-a5d7-bbf0f8dad833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4326e62c0a344c059172aea43c0bdf52'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.072585 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1009/2033] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:41 2022] DELETE /identity/v3/users/4326e62c0a344c059172aea43c0bdf52 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:42.073953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b11c-74c0-4d2c-a66f-1939afd4a5b4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.074478 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b11c-74c0-4d2c-a66f-1939afd4a5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.074881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4b11c-74c0-4d2c-a66f-1939afd4a5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.077841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-49f345d7-e7f8-49cd-bcce-1cf81d90935c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97cddf67faad42fe96a4d7e9a1dcf286'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.085830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-49f345d7-e7f8-49cd-bcce-1cf81d90935c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97cddf67faad42fe96a4d7e9a1dcf286'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.104696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-49f345d7-e7f8-49cd-bcce-1cf81d90935c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97cddf67faad42fe96a4d7e9a1dcf286'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.106180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-55f4b11c-74c0-4d2c-a66f-1939afd4a5b4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:42.108825 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-55f4b11c-74c0-4d2c-a66f-1939afd4a5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:42.121755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-49f345d7-e7f8-49cd-bcce-1cf81d90935c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97cddf67faad42fe96a4d7e9a1dcf286'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.122762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-49f345d7-e7f8-49cd-bcce-1cf81d90935c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97cddf67faad42fe96a4d7e9a1dcf286'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.132692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1025/2034] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:41 2022] DELETE /identity/v3/users/97cddf67faad42fe96a4d7e9a1dcf286 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:42.137098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f43f-5e92-4b25-89e5-31b7f0ffe2fe None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.137513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f43f-5e92-4b25-89e5-31b7f0ffe2fe None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.137958 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4f43f-5e92-4b25-89e5-31b7f0ffe2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.162380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-39e4f43f-5e92-4b25-89e5-31b7f0ffe2fe None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:42.164025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-39e4f43f-5e92-4b25-89e5-31b7f0ffe2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:42.223621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1010/2035] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:42.232926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fe6d5-8c30-4368-bf32-c4f5ee21eaab None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.233214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fe6d5-8c30-4368-bf32-c4f5ee21eaab None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.233489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fe6d5-8c30-4368-bf32-c4f5ee21eaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.240600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:42.262892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d18fe6d5-8c30-4368-bf32-c4f5ee21eaab None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:42.263287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1026/2036] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:42.267674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d18fe6d5-8c30-4368-bf32-c4f5ee21eaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:42.275178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f43f-5e92-4b25-89e5-31b7f0ffe2fe None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:42.279110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-39e4f43f-5e92-4b25-89e5-31b7f0ffe2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:42.281175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1011/2037] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:42.286163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fe6d5-8c30-4368-bf32-c4f5ee21eaab None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:42.297705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fe6d5-8c30-4368-bf32-c4f5ee21eaab None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:42.304307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f42d58-1162-4856-8c97-95c1700c8400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:42.305235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42d58-1162-4856-8c97-95c1700c8400 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.305617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42d58-1162-4856-8c97-95c1700c8400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.305993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42d58-1162-4856-8c97-95c1700c8400 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.309726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f42d58-1162-4856-8c97-95c1700c8400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:42.309916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f42d58-1162-4856-8c97-95c1700c8400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:42.311671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f42d58-1162-4856-8c97-95c1700c8400 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:42.327318 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1012/2038] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:23:42.332456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f42d58-1162-4856-8c97-95c1700c8400 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:42.347991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f42d58-1162-4856-8c97-95c1700c8400 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:42.352880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cd69c-f4be-4b24-a9ce-d16b15d93f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:42.353597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cd69c-f4be-4b24-a9ce-d16b15d93f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.353955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cd69c-f4be-4b24-a9ce-d16b15d93f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.354321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cd69c-f4be-4b24-a9ce-d16b15d93f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.355026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cd69c-f4be-4b24-a9ce-d16b15d93f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:42.355634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4f43f-5e92-4b25-89e5-31b7f0ffe2fe None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:42.357075 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cd69c-f4be-4b24-a9ce-d16b15d93f24 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:42.359496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135df8a-8df7-4fe9-9c95-199bc5dbe2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:42.360215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135df8a-8df7-4fe9-9c95-199bc5dbe2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.360560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135df8a-8df7-4fe9-9c95-199bc5dbe2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.360900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135df8a-8df7-4fe9-9c95-199bc5dbe2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.376521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135df8a-8df7-4fe9-9c95-199bc5dbe2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:42.378020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135df8a-8df7-4fe9-9c95-199bc5dbe2f0 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:42.388615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1027/2039] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:42.393872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1013/2040] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:42 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:42.399204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135df8a-8df7-4fe9-9c95-199bc5dbe2f0 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:42.410769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135df8a-8df7-4fe9-9c95-199bc5dbe2f0 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:42.430289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cd69c-f4be-4b24-a9ce-d16b15d93f24 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:42.432359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6f3cd69c-f4be-4b24-a9ce-d16b15d93f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:42.482051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:42.500873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56887e-9845-4322-a13c-e43e3b373daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:42.501849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56887e-9845-4322-a13c-e43e3b373daf admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.502313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56887e-9845-4322-a13c-e43e3b373daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.502609 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56887e-9845-4322-a13c-e43e3b373daf admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.503238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56887e-9845-4322-a13c-e43e3b373daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:42.505873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56887e-9845-4322-a13c-e43e3b373daf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:42.532239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1028/2041] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:42 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:42.538504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56887e-9845-4322-a13c-e43e3b373daf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:42.546057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cd69c-f4be-4b24-a9ce-d16b15d93f24 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:42.551562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56887e-9845-4322-a13c-e43e3b373daf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:42.557346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:42.558186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.558474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.558970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] PATH_INFO: `/v3/projects/bd5b3f6b257247699c6a857697eaee28` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.560301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd5b3f6b257247699c6a857697eaee28)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:42.563033 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:42.568823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bb36f-c6d5-4ba0-885d-73ed15c0ea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:42.569766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bb36f-c6d5-4ba0-885d-73ed15c0ea5e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.570223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bb36f-c6d5-4ba0-885d-73ed15c0ea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.570668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bb36f-c6d5-4ba0-885d-73ed15c0ea5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.573017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bb36f-c6d5-4ba0-885d-73ed15c0ea5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:42.575907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553bb36f-c6d5-4ba0-885d-73ed15c0ea5e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:42.590056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1029/2042] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:42.594325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bb36f-c6d5-4ba0-885d-73ed15c0ea5e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:42.609260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bb36f-c6d5-4ba0-885d-73ed15c0ea5e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:42.615800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631330c-993c-46fb-aee4-4ea9a48bef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:42.616490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631330c-993c-46fb-aee4-4ea9a48bef12 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.616946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631330c-993c-46fb-aee4-4ea9a48bef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.617298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631330c-993c-46fb-aee4-4ea9a48bef12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.618298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631330c-993c-46fb-aee4-4ea9a48bef12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:42.619802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631330c-993c-46fb-aee4-4ea9a48bef12 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:42.625962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd5b3f6b257247699c6a857697eaee28', 'request_id': 'req-33f7651e-fd92-46b2-aa0f-90db51dff5eb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.633988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1030/2043] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:42.636694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd5b3f6b257247699c6a857697eaee28', 'request_id': 'req-33f7651e-fd92-46b2-aa0f-90db51dff5eb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.638312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631330c-993c-46fb-aee4-4ea9a48bef12 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:42.645533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd5b3f6b257247699c6a857697eaee28', 'request_id': 'req-33f7651e-fd92-46b2-aa0f-90db51dff5eb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.651965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631330c-993c-46fb-aee4-4ea9a48bef12 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:42.661582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] The token cache is being invalidate because project bd5b3f6b257247699c6a857697eaee28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:42.661884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.662664 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-33f7651e-fd92-46b2-aa0f-90db51dff5eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.664923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1014/2044] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:42 2022] DELETE /identity/v3/projects/bd5b3f6b257247699c6a857697eaee28 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:42.669202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e778-124c-4cf0-881a-21af0b283123 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.669489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e778-124c-4cf0-881a-21af0b283123 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.670216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e778-124c-4cf0-881a-21af0b283123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.695679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-50b1e778-124c-4cf0-881a-21af0b283123 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:42.696916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-50b1e778-124c-4cf0-881a-21af0b283123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:42.733524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffc898-dc19-4009-a453-1f29e6273af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:42.734345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffc898-dc19-4009-a453-1f29e6273af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.734880 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffc898-dc19-4009-a453-1f29e6273af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.735229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffc898-dc19-4009-a453-1f29e6273af0 admin admin] PATH_INFO: `/v3/projects/18752b93c34e4bc0a594399a594b472e/users/7f611bff69974fdfb48a99b0006ed381/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.750612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:42.759175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffc898-dc19-4009-a453-1f29e6273af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18752b93c34e4bc0a594399a594b472e, user_id=7f611bff69974fdfb48a99b0006ed381, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:42.762216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffc898-dc19-4009-a453-1f29e6273af0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:42.768561 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1015/2045] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:42.775659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1e778-124c-4cf0-881a-21af0b283123 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:42.775659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-50b1e778-124c-4cf0-881a-21af0b283123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:42.778530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1031/2046] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:42 2022] PUT /identity/v3/projects/18752b93c34e4bc0a594399a594b472e/users/7f611bff69974fdfb48a99b0006ed381/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:42.779853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37242568-d7f0-4f78-883e-15499e6e5a24 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.780140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37242568-d7f0-4f78-883e-15499e6e5a24 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.780418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37242568-d7f0-4f78-883e-15499e6e5a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.794058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1e778-124c-4cf0-881a-21af0b283123 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:42.803055 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-37242568-d7f0-4f78-883e-15499e6e5a24 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:42.804297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-37242568-d7f0-4f78-883e-15499e6e5a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:42.855035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:42.865585 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:42.866380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.866722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.867280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] PATH_INFO: `/v3/projects/6a5568d6c3964ab08249fb03c0a32533` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.868530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5568d6c3964ab08249fb03c0a32533)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:42.869827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1032/2047] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:42.871032 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73495c9-d110-47e1-89f8-c85e2207cf85 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:42.871321 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73495c9-d110-47e1-89f8-c85e2207cf85 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:42.871597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73495c9-d110-47e1-89f8-c85e2207cf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:42.874008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:42.901893 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c73495c9-d110-47e1-89f8-c85e2207cf85 None None] MFA Rules not processed for user `7f611bff69974fdfb48a99b0006ed381`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:42.903161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c73495c9-d110-47e1-89f8-c85e2207cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:42.927661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5568d6c3964ab08249fb03c0a32533', 'request_id': 'req-f398c38a-ae75-44f4-85df-8d860f4202a0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.935444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5568d6c3964ab08249fb03c0a32533', 'request_id': 'req-f398c38a-ae75-44f4-85df-8d860f4202a0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.943966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5568d6c3964ab08249fb03c0a32533', 'request_id': 'req-f398c38a-ae75-44f4-85df-8d860f4202a0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.957156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] The token cache is being invalidate because project 6a5568d6c3964ab08249fb03c0a32533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:42.957549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.958347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:42.960320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1016/2048] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:42 2022] DELETE /identity/v3/projects/6a5568d6c3964ab08249fb03c0a32533 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:42.961416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:42.962799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:42.980769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1033/2049] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:42.982008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73495c9-d110-47e1-89f8-c85e2207cf85 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:42.983454 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c73495c9-d110-47e1-89f8-c85e2207cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:43.001703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73495c9-d110-47e1-89f8-c85e2207cf85 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.039098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398c38a-ae75-44f4-85df-8d860f4202a0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.044539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcef4a-aa23-45b2-94ef-3acd784d93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.045158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcef4a-aa23-45b2-94ef-3acd784d93f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.045550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcef4a-aa23-45b2-94ef-3acd784d93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.045881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcef4a-aa23-45b2-94ef-3acd784d93f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.046579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcef4a-aa23-45b2-94ef-3acd784d93f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:43.046897 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcef4a-aa23-45b2-94ef-3acd784d93f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.048516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fcef4a-aa23-45b2-94ef-3acd784d93f2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.064033 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1017/2050] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:43.064033 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcef4a-aa23-45b2-94ef-3acd784d93f2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:43.064309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.064408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b9fcef4a-aa23-45b2-94ef-3acd784d93f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:43.064511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.064511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.064511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] PATH_INFO: `/v3/users/3acf930f61aa46809af34feaa52bbb19` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.065077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3acf930f61aa46809af34feaa52bbb19)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.067772 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.090073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:43.118578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3acf930f61aa46809af34feaa52bbb19'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.125452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcef4a-aa23-45b2-94ef-3acd784d93f2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.126583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3acf930f61aa46809af34feaa52bbb19'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.130098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6316147-35a2-4025-a1d6-a3189ddbca3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.130711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6316147-35a2-4025-a1d6-a3189ddbca3b service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.130993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6316147-35a2-4025-a1d6-a3189ddbca3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.131269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6316147-35a2-4025-a1d6-a3189ddbca3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.139305 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3acf930f61aa46809af34feaa52bbb19'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.147395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3acf930f61aa46809af34feaa52bbb19'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.148091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3acf930f61aa46809af34feaa52bbb19'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.154634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1034/2051] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:42 2022] DELETE /identity/v3/users/3acf930f61aa46809af34feaa52bbb19 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:43.155039 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:43.156351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:43.172206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:43.217234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6316147-35a2-4025-a1d6-a3189ddbca3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.219103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6316147-35a2-4025-a1d6-a3189ddbca3b service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.230335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1018/2052] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:43.262573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6316147-35a2-4025-a1d6-a3189ddbca3b service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:43.264314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf3550-caf6-4009-a378-e2549ac94299 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.265617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e6316147-35a2-4025-a1d6-a3189ddbca3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:43.273745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572d5f1-004c-4aa4-a463-dc8d2fbbe8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.274775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572d5f1-004c-4aa4-a463-dc8d2fbbe8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.275144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572d5f1-004c-4aa4-a463-dc8d2fbbe8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.275554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572d5f1-004c-4aa4-a463-dc8d2fbbe8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.276367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572d5f1-004c-4aa4-a463-dc8d2fbbe8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.278744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572d5f1-004c-4aa4-a463-dc8d2fbbe8d1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.284816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6316147-35a2-4025-a1d6-a3189ddbca3b service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.296817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df26d86-b61a-48e6-8eb0-b4be6f4addad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.297852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26d86-b61a-48e6-8eb0-b4be6f4addad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.298415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26d86-b61a-48e6-8eb0-b4be6f4addad admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.298659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26d86-b61a-48e6-8eb0-b4be6f4addad admin admin] PATH_INFO: `/v3/users/7f611bff69974fdfb48a99b0006ed381` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.300815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df26d86-b61a-48e6-8eb0-b4be6f4addad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f611bff69974fdfb48a99b0006ed381)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.304918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df26d86-b61a-48e6-8eb0-b4be6f4addad admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.326529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1035/2053] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:43 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:43.332464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572d5f1-004c-4aa4-a463-dc8d2fbbe8d1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:43.399121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2df26d86-b61a-48e6-8eb0-b4be6f4addad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f611bff69974fdfb48a99b0006ed381'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.400395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2df26d86-b61a-48e6-8eb0-b4be6f4addad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f611bff69974fdfb48a99b0006ed381'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.401610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2df26d86-b61a-48e6-8eb0-b4be6f4addad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f611bff69974fdfb48a99b0006ed381'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.412059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2df26d86-b61a-48e6-8eb0-b4be6f4addad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f611bff69974fdfb48a99b0006ed381'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.423286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2df26d86-b61a-48e6-8eb0-b4be6f4addad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f611bff69974fdfb48a99b0006ed381'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.451688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1019/2054] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:43 2022] DELETE /identity/v3/users/7f611bff69974fdfb48a99b0006ed381 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:43.453391 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a2c8e-9d18-40e9-a23e-cae34424ed59 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.454499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a2c8e-9d18-40e9-a23e-cae34424ed59 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.455040 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a2c8e-9d18-40e9-a23e-cae34424ed59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.470204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572d5f1-004c-4aa4-a463-dc8d2fbbe8d1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.487459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e39a2c8e-9d18-40e9-a23e-cae34424ed59 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:43.489751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e39a2c8e-9d18-40e9-a23e-cae34424ed59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:43.531695 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:43.575204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d2349-5e53-4740-9d54-4772bdb633e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.575918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d2349-5e53-4740-9d54-4772bdb633e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.576264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d2349-5e53-4740-9d54-4772bdb633e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.576603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d2349-5e53-4740-9d54-4772bdb633e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.577350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d2349-5e53-4740-9d54-4772bdb633e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.579374 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d2349-5e53-4740-9d54-4772bdb633e4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.581565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1020/2055] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:43.582462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a2c8e-9d18-40e9-a23e-cae34424ed59 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:43.583765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e39a2c8e-9d18-40e9-a23e-cae34424ed59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:43.596686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a2c8e-9d18-40e9-a23e-cae34424ed59 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.602995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.603629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.603905 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.604174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] PATH_INFO: `/v3/projects/08c315d9181f466fa757eee66fd1f4c3` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.605299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c315d9181f466fa757eee66fd1f4c3)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.605582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1036/2056] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:43 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:43.607249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.609767 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d2349-5e53-4740-9d54-4772bdb633e4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:43.611555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-910d2349-5e53-4740-9d54-4772bdb633e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:43.650872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:43.659476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c315d9181f466fa757eee66fd1f4c3', 'request_id': 'req-bb78233e-f6c3-41ba-bbc2-225aec0367f0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.669438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c315d9181f466fa757eee66fd1f4c3', 'request_id': 'req-bb78233e-f6c3-41ba-bbc2-225aec0367f0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.679535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c315d9181f466fa757eee66fd1f4c3', 'request_id': 'req-bb78233e-f6c3-41ba-bbc2-225aec0367f0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.679889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d2349-5e53-4740-9d54-4772bdb633e4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.694681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] The token cache is being invalidate because project 08c315d9181f466fa757eee66fd1f4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:43.694974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.695762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:43.697302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1021/2057] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:43 2022] DELETE /identity/v3/projects/08c315d9181f466fa757eee66fd1f4c3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:43.698098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:43.699412 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:43.732953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf8bd5-d123-45c2-8dc2-c15935c752d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.733560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf8bd5-d123-45c2-8dc2-c15935c752d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.733842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf8bd5-d123-45c2-8dc2-c15935c752d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.734143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf8bd5-d123-45c2-8dc2-c15935c752d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.735881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7ddf8bd5-d123-45c2-8dc2-c15935c752d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:43.774545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78233e-f6c3-41ba-bbc2-225aec0367f0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.781776 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169a849-4583-4272-bb7f-b773a3003916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.782463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169a849-4583-4272-bb7f-b773a3003916 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.782742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169a849-4583-4272-bb7f-b773a3003916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.783009 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169a849-4583-4272-bb7f-b773a3003916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.783656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169a849-4583-4272-bb7f-b773a3003916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.785905 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169a849-4583-4272-bb7f-b773a3003916 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.796500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1022/2058] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:43.797959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d747aa-e87e-40a2-80f4-87f0e92b6dc9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.798424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d747aa-e87e-40a2-80f4-87f0e92b6dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.802282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d747aa-e87e-40a2-80f4-87f0e92b6dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.816932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf8bd5-d123-45c2-8dc2-c15935c752d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.819476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf8bd5-d123-45c2-8dc2-c15935c752d6 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.824393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-42d747aa-e87e-40a2-80f4-87f0e92b6dc9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:43.826158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-42d747aa-e87e-40a2-80f4-87f0e92b6dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:43.834137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1037/2059] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:43.835127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf8bd5-d123-45c2-8dc2-c15935c752d6 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:43.842217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1023/2060] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:43.851845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d5e5f-6b36-40d7-9aba-8bb45f0cd8a0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.852304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d5e5f-6b36-40d7-9aba-8bb45f0cd8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.852874 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d5e5f-6b36-40d7-9aba-8bb45f0cd8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.855066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf8bd5-d123-45c2-8dc2-c15935c752d6 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.863427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4443-e34b-44ca-a6e0-8f5afd5e0c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.864213 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4443-e34b-44ca-a6e0-8f5afd5e0c04 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.864571 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4443-e34b-44ca-a6e0-8f5afd5e0c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.864912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4443-e34b-44ca-a6e0-8f5afd5e0c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.865865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef4443-e34b-44ca-a6e0-8f5afd5e0c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.868047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef4443-e34b-44ca-a6e0-8f5afd5e0c04 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.880210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1038/2061] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:43.884602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4443-e34b-44ca-a6e0-8f5afd5e0c04 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:43.886830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-603d5e5f-6b36-40d7-9aba-8bb45f0cd8a0 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:43.888397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-603d5e5f-6b36-40d7-9aba-8bb45f0cd8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:43.900042 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1024/2062] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:43.906281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d5e5f-6b36-40d7-9aba-8bb45f0cd8a0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:43.910211 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4443-e34b-44ca-a6e0-8f5afd5e0c04 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.920732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420c29c-1def-4e7c-84c0-17804b657a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.921426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420c29c-1def-4e7c-84c0-17804b657a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.921733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420c29c-1def-4e7c-84c0-17804b657a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.921902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d5e5f-6b36-40d7-9aba-8bb45f0cd8a0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.922088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420c29c-1def-4e7c-84c0-17804b657a8d admin admin] PATH_INFO: `/v3/projects/54a2d2d065694da3b32cf6d8d2caa476/users/e79bcbcb81804744a6f159bfeb73a251/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.929501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41124e62-7892-4ceb-8159-a5e5707da663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:43.930143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41124e62-7892-4ceb-8159-a5e5707da663 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.930565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41124e62-7892-4ceb-8159-a5e5707da663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.930764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41124e62-7892-4ceb-8159-a5e5707da663 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:43.931883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41124e62-7892-4ceb-8159-a5e5707da663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:43.932211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41124e62-7892-4ceb-8159-a5e5707da663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.933807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41124e62-7892-4ceb-8159-a5e5707da663 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.939440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:43.944008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420c29c-1def-4e7c-84c0-17804b657a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a2d2d065694da3b32cf6d8d2caa476, user_id=e79bcbcb81804744a6f159bfeb73a251, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:43.947732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420c29c-1def-4e7c-84c0-17804b657a8d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:43.952729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1025/2063] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:43.953897 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41124e62-7892-4ceb-8159-a5e5707da663 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:43.969367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1039/2064] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:43 2022] PUT /identity/v3/projects/54a2d2d065694da3b32cf6d8d2caa476/users/e79bcbcb81804744a6f159bfeb73a251/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:43.973538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41124e62-7892-4ceb-8159-a5e5707da663 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:43.982703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709820d7-5e06-4756-b31c-c2c17bb10e98 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:43.983196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709820d7-5e06-4756-b31c-c2c17bb10e98 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:43.987619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709820d7-5e06-4756-b31c-c2c17bb10e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.071840 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-709820d7-5e06-4756-b31c-c2c17bb10e98 None None] MFA Rules not processed for user `e79bcbcb81804744a6f159bfeb73a251`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:44.072411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-709820d7-5e06-4756-b31c-c2c17bb10e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:44.080336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8426c-26c2-4510-a26a-f6fb115df457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.082206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8426c-26c2-4510-a26a-f6fb115df457 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.083339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8426c-26c2-4510-a26a-f6fb115df457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.083821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8426c-26c2-4510-a26a-f6fb115df457 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.086069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8426c-26c2-4510-a26a-f6fb115df457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.088390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8426c-26c2-4510-a26a-f6fb115df457 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.134274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1026/2065] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:43 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:44.139104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8426c-26c2-4510-a26a-f6fb115df457 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.175280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:44.199066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1040/2066] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:44.203498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709820d7-5e06-4756-b31c-c2c17bb10e98 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.216948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709820d7-5e06-4756-b31c-c2c17bb10e98 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.225702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8426c-26c2-4510-a26a-f6fb115df457 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.227193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e0871-c452-4b7f-b739-e0997588c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.230046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e0871-c452-4b7f-b739-e0997588c58f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.230412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e0871-c452-4b7f-b739-e0997588c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.230697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e0871-c452-4b7f-b739-e0997588c58f admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.231440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e0871-c452-4b7f-b739-e0997588c58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.231630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7b9af-8a4e-487d-a764-df406942dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.232904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7b9af-8a4e-487d-a764-df406942dfd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.232904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7b9af-8a4e-487d-a764-df406942dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.232904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7b9af-8a4e-487d-a764-df406942dfd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.233422 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e0871-c452-4b7f-b739-e0997588c58f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.233798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7b9af-8a4e-487d-a764-df406942dfd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.236673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7b9af-8a4e-487d-a764-df406942dfd1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.266198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1027/2067] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:44 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:44.266198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7b9af-8a4e-487d-a764-df406942dfd1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.268378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1041/2068] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:44 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:44.269769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e0871-c452-4b7f-b739-e0997588c58f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.273102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-05c7b9af-8a4e-487d-a764-df406942dfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:44.287790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7b9af-8a4e-487d-a764-df406942dfd1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.337892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e0871-c452-4b7f-b739-e0997588c58f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.343047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a46b7-1bea-4b9f-b9f4-0f4d9ec627d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.343656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a46b7-1bea-4b9f-b9f4-0f4d9ec627d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.343935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a46b7-1bea-4b9f-b9f4-0f4d9ec627d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.344206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a46b7-1bea-4b9f-b9f4-0f4d9ec627d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.344857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a46b7-1bea-4b9f-b9f4-0f4d9ec627d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.346578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a46b7-1bea-4b9f-b9f4-0f4d9ec627d9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.352139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.352771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.353050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.353319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] PATH_INFO: `/v3/projects/18752b93c34e4bc0a594399a594b472e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.354558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=18752b93c34e4bc0a594399a594b472e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.356567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.357245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1042/2069] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:44.358133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a46b7-1bea-4b9f-b9f4-0f4d9ec627d9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.371539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a46b7-1bea-4b9f-b9f4-0f4d9ec627d9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.376936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1542808-a3ea-4d7c-ae3b-1d344af7e386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.377525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1542808-a3ea-4d7c-ae3b-1d344af7e386 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.377809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1542808-a3ea-4d7c-ae3b-1d344af7e386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.378114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1542808-a3ea-4d7c-ae3b-1d344af7e386 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.379287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1542808-a3ea-4d7c-ae3b-1d344af7e386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.381208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1542808-a3ea-4d7c-ae3b-1d344af7e386 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.409034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1043/2070] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:44 2022] POST /identity/v3/users => generated 300 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:44.409034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1542808-a3ea-4d7c-ae3b-1d344af7e386 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.409339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18752b93c34e4bc0a594399a594b472e', 'request_id': 'req-c132cbcf-695c-450c-9a62-63038ffba47e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:44.413341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18752b93c34e4bc0a594399a594b472e', 'request_id': 'req-c132cbcf-695c-450c-9a62-63038ffba47e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:44.416627 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1542808-a3ea-4d7c-ae3b-1d344af7e386 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.423051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18752b93c34e4bc0a594399a594b472e', 'request_id': 'req-c132cbcf-695c-450c-9a62-63038ffba47e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:44.434469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] The token cache is being invalidate because project 18752b93c34e4bc0a594399a594b472e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:44.434835 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:44.435619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:44.437184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1028/2071] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:44 2022] DELETE /identity/v3/projects/18752b93c34e4bc0a594399a594b472e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:44.438140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.442326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:44.454732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:44.481928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19c6d-5241-4137-97f5-1c5411e065a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.482643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19c6d-5241-4137-97f5-1c5411e065a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.482934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19c6d-5241-4137-97f5-1c5411e065a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.483191 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19c6d-5241-4137-97f5-1c5411e065a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.483855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab19c6d-5241-4137-97f5-1c5411e065a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.485529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab19c6d-5241-4137-97f5-1c5411e065a6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.493392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:44.496966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1044/2072] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:44.498249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2215cf-9b97-449e-ad54-c3c94a17bc3b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.498831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2215cf-9b97-449e-ad54-c3c94a17bc3b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.498941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2215cf-9b97-449e-ad54-c3c94a17bc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.518726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132cbcf-695c-450c-9a62-63038ffba47e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.522919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bb2215cf-9b97-449e-ad54-c3c94a17bc3b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:44.524131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bb2215cf-9b97-449e-ad54-c3c94a17bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:44.529755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6e46a-4afb-4067-a33b-34fecd40b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.530408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6e46a-4afb-4067-a33b-34fecd40b70d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.530689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6e46a-4afb-4067-a33b-34fecd40b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.530961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6e46a-4afb-4067-a33b-34fecd40b70d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.531646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6e46a-4afb-4067-a33b-34fecd40b70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.533199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6e46a-4afb-4067-a33b-34fecd40b70d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.543443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1045/2073] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:44.543443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2215cf-9b97-449e-ad54-c3c94a17bc3b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.545125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bb2215cf-9b97-449e-ad54-c3c94a17bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:44.550769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1029/2074] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:44.550769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13c54e-5d8d-4a4f-9c4a-f3bc3867dc91 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.550769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13c54e-5d8d-4a4f-9c4a-f3bc3867dc91 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.550769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13c54e-5d8d-4a4f-9c4a-f3bc3867dc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.561567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2215cf-9b97-449e-ad54-c3c94a17bc3b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.566962 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10393-1368-4fc6-977d-84faec00b43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.567628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10393-1368-4fc6-977d-84faec00b43f admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.567906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10393-1368-4fc6-977d-84faec00b43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.568182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10393-1368-4fc6-977d-84faec00b43f admin admin] PATH_INFO: `/v3/projects/1d52a25f2e354462bd8c2e74b03e19c2/users/2d761936840644d696cf6825914ad584/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.581339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0b13c54e-5d8d-4a4f-9c4a-f3bc3867dc91 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:44.582980 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0b13c54e-5d8d-4a4f-9c4a-f3bc3867dc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:44.589737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b10393-1368-4fc6-977d-84faec00b43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d52a25f2e354462bd8c2e74b03e19c2, user_id=2d761936840644d696cf6825914ad584, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.592590 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b10393-1368-4fc6-977d-84faec00b43f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.594058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1030/2075] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:44.594744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13c54e-5d8d-4a4f-9c4a-f3bc3867dc91 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.607400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13c54e-5d8d-4a4f-9c4a-f3bc3867dc91 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.615594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1046/2076] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:44 2022] PUT /identity/v3/projects/1d52a25f2e354462bd8c2e74b03e19c2/users/2d761936840644d696cf6825914ad584/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:44.616765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10393-1368-4fc6-977d-84faec00b43f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.685735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ebf7c-d8c9-4ff4-afbb-3e16c7949350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.686607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ebf7c-d8c9-4ff4-afbb-3e16c7949350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.686951 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ebf7c-d8c9-4ff4-afbb-3e16c7949350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.687468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ebf7c-d8c9-4ff4-afbb-3e16c7949350 admin admin] PATH_INFO: `/v3/projects/1efecf2303194b9ca760d972794985ee/users/4bdee6f127c743758aebe4d3e7473cb8/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.701753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10393-1368-4fc6-977d-84faec00b43f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.707161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39ffb8-f1e6-4a72-bdb8-1a4a2c1725a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.707771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39ffb8-f1e6-4a72-bdb8-1a4a2c1725a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.708052 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39ffb8-f1e6-4a72-bdb8-1a4a2c1725a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.708327 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39ffb8-f1e6-4a72-bdb8-1a4a2c1725a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.708981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39ffb8-f1e6-4a72-bdb8-1a4a2c1725a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:44.709265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ebf7c-d8c9-4ff4-afbb-3e16c7949350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efecf2303194b9ca760d972794985ee, user_id=4bdee6f127c743758aebe4d3e7473cb8, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.709388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39ffb8-f1e6-4a72-bdb8-1a4a2c1725a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.710924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39ffb8-f1e6-4a72-bdb8-1a4a2c1725a8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.711929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ebf7c-d8c9-4ff4-afbb-3e16c7949350 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.723587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1047/2077] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:44.725025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdde47-0a05-4944-870c-500e34674891 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.725531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdde47-0a05-4944-870c-500e34674891 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.725831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1031/2078] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:44 2022] PUT /identity/v3/projects/1efecf2303194b9ca760d972794985ee/users/4bdee6f127c743758aebe4d3e7473cb8/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:44.725960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdde47-0a05-4944-870c-500e34674891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.730965 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ebf7c-d8c9-4ff4-afbb-3e16c7949350 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.755122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cccdde47-0a05-4944-870c-500e34674891 None None] MFA Rules not processed for user `2d761936840644d696cf6825914ad584`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:44.756332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cccdde47-0a05-4944-870c-500e34674891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:44.796210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ebf7c-d8c9-4ff4-afbb-3e16c7949350 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.802578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc6196-d602-4653-a9f7-d51ace8ffe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.803185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6196-d602-4653-a9f7-d51ace8ffe8c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.803463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6196-d602-4653-a9f7-d51ace8ffe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.803732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc6196-d602-4653-a9f7-d51ace8ffe8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.804370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc6196-d602-4653-a9f7-d51ace8ffe8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.805973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc6196-d602-4653-a9f7-d51ace8ffe8c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.821900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1032/2079] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:44.821900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc6196-d602-4653-a9f7-d51ace8ffe8c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.825023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1048/2080] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:44.827116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdde47-0a05-4944-870c-500e34674891 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.831247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc6196-d602-4653-a9f7-d51ace8ffe8c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.835880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcea3e-0652-46e6-bc5f-99e9808425aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.836462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcea3e-0652-46e6-bc5f-99e9808425aa admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.836738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcea3e-0652-46e6-bc5f-99e9808425aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.837014 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcea3e-0652-46e6-bc5f-99e9808425aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.837620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcea3e-0652-46e6-bc5f-99e9808425aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.838203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdde47-0a05-4944-870c-500e34674891 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.839907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bcea3e-0652-46e6-bc5f-99e9808425aa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.843237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2446b-7a1f-4a85-8bbb-728d42d203a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:44.844042 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2446b-7a1f-4a85-8bbb-728d42d203a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.844340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2446b-7a1f-4a85-8bbb-728d42d203a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.844604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2446b-7a1f-4a85-8bbb-728d42d203a5 admin admin] PATH_INFO: `/v3/projects/1efecf2303194b9ca760d972794985ee/users/4bdee6f127c743758aebe4d3e7473cb8/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.846636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2446b-7a1f-4a85-8bbb-728d42d203a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efecf2303194b9ca760d972794985ee, user_id=4bdee6f127c743758aebe4d3e7473cb8, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:44.849578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2446b-7a1f-4a85-8bbb-728d42d203a5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:44.860264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1049/2081] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:44 2022] PUT /identity/v3/projects/1efecf2303194b9ca760d972794985ee/users/4bdee6f127c743758aebe4d3e7473cb8/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:44.861046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2446b-7a1f-4a85-8bbb-728d42d203a5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:44.881444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1033/2082] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:44 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:44.881444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6d68f-1a35-4025-9f02-9b7ef95392e3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:44.881444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6d68f-1a35-4025-9f02-9b7ef95392e3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:44.881444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6d68f-1a35-4025-9f02-9b7ef95392e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:44.882311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:44.913173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e7c6d68f-1a35-4025-9f02-9b7ef95392e3 None None] MFA Rules not processed for user `4bdee6f127c743758aebe4d3e7473cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:44.914539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e7c6d68f-1a35-4025-9f02-9b7ef95392e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:44.933360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2446b-7a1f-4a85-8bbb-728d42d203a5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:44.942306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:44.992334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1034/2083] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:44.993159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6d68f-1a35-4025-9f02-9b7ef95392e3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.001396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f6b0e-f93b-46cf-9335-6004a24cf506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.002348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6b0e-f93b-46cf-9335-6004a24cf506 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.002652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6b0e-f93b-46cf-9335-6004a24cf506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.002902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6b0e-f93b-46cf-9335-6004a24cf506 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.003539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f6b0e-f93b-46cf-9335-6004a24cf506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.005460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f6b0e-f93b-46cf-9335-6004a24cf506 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.035621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1050/2084] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:44 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:45.035621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f6b0e-f93b-46cf-9335-6004a24cf506 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.035621 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9c3f6b0e-f93b-46cf-9335-6004a24cf506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:45.061742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6d68f-1a35-4025-9f02-9b7ef95392e3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.101712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f6b0e-f93b-46cf-9335-6004a24cf506 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.105542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f883b5-c48f-4a28-88c9-92fe63c12364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.106302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f883b5-c48f-4a28-88c9-92fe63c12364 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.106584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f883b5-c48f-4a28-88c9-92fe63c12364 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.106988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f883b5-c48f-4a28-88c9-92fe63c12364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.124401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d76ecc-0319-47db-a0ea-a037f69dd5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.125009 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76ecc-0319-47db-a0ea-a037f69dd5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.125289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76ecc-0319-47db-a0ea-a037f69dd5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.125562 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76ecc-0319-47db-a0ea-a037f69dd5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.126216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d76ecc-0319-47db-a0ea-a037f69dd5d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.128589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d76ecc-0319-47db-a0ea-a037f69dd5d0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.152543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1035/2085] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:44 2022] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:45.152543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d76ecc-0319-47db-a0ea-a037f69dd5d0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.160806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d76ecc-0319-47db-a0ea-a037f69dd5d0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.165409 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd465e72-9f74-4e1a-be59-4b6839aa0b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.166187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd465e72-9f74-4e1a-be59-4b6839aa0b34 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.166526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd465e72-9f74-4e1a-be59-4b6839aa0b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.166802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd465e72-9f74-4e1a-be59-4b6839aa0b34 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.167411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd465e72-9f74-4e1a-be59-4b6839aa0b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.169047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:45.169303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd465e72-9f74-4e1a-be59-4b6839aa0b34 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.171459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f883b5-c48f-4a28-88c9-92fe63c12364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.173456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f883b5-c48f-4a28-88c9-92fe63c12364 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.185671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1051/2086] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:45.186520 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f883b5-c48f-4a28-88c9-92fe63c12364 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.190983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1036/2087] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:45 2022] POST /identity/v3/users => generated 299 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:45.194922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd465e72-9f74-4e1a-be59-4b6839aa0b34 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.199941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f883b5-c48f-4a28-88c9-92fe63c12364 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.204795 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f574a74-3ca5-4de3-a1a2-3d403a8d5e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.205393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f574a74-3ca5-4de3-a1a2-3d403a8d5e64 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.205679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f574a74-3ca5-4de3-a1a2-3d403a8d5e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.205946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f574a74-3ca5-4de3-a1a2-3d403a8d5e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.206684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f574a74-3ca5-4de3-a1a2-3d403a8d5e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.207088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd465e72-9f74-4e1a-be59-4b6839aa0b34 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.208273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f574a74-3ca5-4de3-a1a2-3d403a8d5e64 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.221226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b996b-694c-4606-92ed-9c8ad3d07c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.221226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b996b-694c-4606-92ed-9c8ad3d07c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.221226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b996b-694c-4606-92ed-9c8ad3d07c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.221226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b996b-694c-4606-92ed-9c8ad3d07c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.221651 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b996b-694c-4606-92ed-9c8ad3d07c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.221651 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b996b-694c-4606-92ed-9c8ad3d07c67 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.221818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1052/2088] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:45.229532 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f574a74-3ca5-4de3-a1a2-3d403a8d5e64 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.232906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1037/2089] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:45.237018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b996b-694c-4606-92ed-9c8ad3d07c67 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.240865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f574a74-3ca5-4de3-a1a2-3d403a8d5e64 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.245664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24ca48-64e6-48f6-ab5c-55606f4cf1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.246310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ca48-64e6-48f6-ab5c-55606f4cf1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.246653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ca48-64e6-48f6-ab5c-55606f4cf1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.247094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24ca48-64e6-48f6-ab5c-55606f4cf1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.247752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24ca48-64e6-48f6-ab5c-55606f4cf1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.248390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b996b-694c-4606-92ed-9c8ad3d07c67 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.249490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b24ca48-64e6-48f6-ab5c-55606f4cf1d9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.253785 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae10a5-78f7-41e4-b3b1-fb6d1a85de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.254493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae10a5-78f7-41e4-b3b1-fb6d1a85de34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.254773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae10a5-78f7-41e4-b3b1-fb6d1a85de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.255583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae10a5-78f7-41e4-b3b1-fb6d1a85de34 admin admin] PATH_INFO: `/v3/projects/c95214ea60544c9dac2e3296a69ffb05/users/f69c233833b74e1c8d9c9475c40fae56/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.265678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1053/2090] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:45.268417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24ca48-64e6-48f6-ab5c-55606f4cf1d9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.272990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae10a5-78f7-41e4-b3b1-fb6d1a85de34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95214ea60544c9dac2e3296a69ffb05, user_id=f69c233833b74e1c8d9c9475c40fae56, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.276168 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae10a5-78f7-41e4-b3b1-fb6d1a85de34 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.280955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24ca48-64e6-48f6-ab5c-55606f4cf1d9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.286074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:45.287748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.288629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.289055 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.289317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] PATH_INFO: `/v3/users/e79bcbcb81804744a6f159bfeb73a251` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.290839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79bcbcb81804744a6f159bfeb73a251)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.292100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1038/2091] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:45 2022] PUT /identity/v3/projects/c95214ea60544c9dac2e3296a69ffb05/users/f69c233833b74e1c8d9c9475c40fae56/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:45.293043 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae10a5-78f7-41e4-b3b1-fb6d1a85de34 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.293818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.342673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79bcbcb81804744a6f159bfeb73a251'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:45.350568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79bcbcb81804744a6f159bfeb73a251'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:45.357517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae10a5-78f7-41e4-b3b1-fb6d1a85de34 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.362241 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd264c4-31b7-4174-9d5d-e4262deb26c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.362751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79bcbcb81804744a6f159bfeb73a251'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:45.362926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd264c4-31b7-4174-9d5d-e4262deb26c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.363215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd264c4-31b7-4174-9d5d-e4262deb26c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.363493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd264c4-31b7-4174-9d5d-e4262deb26c8 admin admin] PATH_INFO: `/v3/projects/96434dc27eda41b5969432a8328a1cb2/users/b0279525895b4cd186f8714153b56d0b/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.371035 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79bcbcb81804744a6f159bfeb73a251'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:45.371653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79bcbcb81804744a6f159bfeb73a251'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:45.377831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1054/2092] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:45 2022] DELETE /identity/v3/users/e79bcbcb81804744a6f159bfeb73a251 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:45.378753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.380084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:45.386244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd264c4-31b7-4174-9d5d-e4262deb26c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96434dc27eda41b5969432a8328a1cb2, user_id=b0279525895b4cd186f8714153b56d0b, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.388894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd264c4-31b7-4174-9d5d-e4262deb26c8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.402709 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1039/2093] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:45 2022] PUT /identity/v3/projects/96434dc27eda41b5969432a8328a1cb2/users/b0279525895b4cd186f8714153b56d0b/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:45.411535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79805cdb-1da0-4bc6-8e88-8a66d61eebaf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.411823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79805cdb-1da0-4bc6-8e88-8a66d61eebaf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.412095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79805cdb-1da0-4bc6-8e88-8a66d61eebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.430365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-79805cdb-1da0-4bc6-8e88-8a66d61eebaf None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:45.431577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-79805cdb-1da0-4bc6-8e88-8a66d61eebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:45.449730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98efe1f-fea4-40b3-a818-0a9c39579cb2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.495722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1040/2094] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:45.496975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ceb55-4bbf-400e-80da-ef3fbddf2a5d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.497242 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ceb55-4bbf-400e-80da-ef3fbddf2a5d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.497706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ceb55-4bbf-400e-80da-ef3fbddf2a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.504673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:45.515607 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5373a26-007a-4228-9fd5-a90a077e1932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.516165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5373a26-007a-4228-9fd5-a90a077e1932 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.516476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5373a26-007a-4228-9fd5-a90a077e1932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.516711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5373a26-007a-4228-9fd5-a90a077e1932 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.517358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5373a26-007a-4228-9fd5-a90a077e1932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.519661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5373a26-007a-4228-9fd5-a90a077e1932 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.531273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1055/2095] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:45.531662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5a4ceb55-4bbf-400e-80da-ef3fbddf2a5d None None] MFA Rules not processed for user `b0279525895b4cd186f8714153b56d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:45.532916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5a4ceb55-4bbf-400e-80da-ef3fbddf2a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:45.535664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5373a26-007a-4228-9fd5-a90a077e1932 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.537382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d5373a26-007a-4228-9fd5-a90a077e1932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:45.597911 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5373a26-007a-4228-9fd5-a90a077e1932 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.601751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1041/2096] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:45.601871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20da61d-c8e9-4f99-926f-2b3ba1cfeb3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.602436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20da61d-c8e9-4f99-926f-2b3ba1cfeb3c service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.602773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20da61d-c8e9-4f99-926f-2b3ba1cfeb3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.603048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20da61d-c8e9-4f99-926f-2b3ba1cfeb3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.605932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ceb55-4bbf-400e-80da-ef3fbddf2a5d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.612854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20da61d-c8e9-4f99-926f-2b3ba1cfeb3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.614325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20da61d-c8e9-4f99-926f-2b3ba1cfeb3c service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.616199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ceb55-4bbf-400e-80da-ef3fbddf2a5d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.620722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660307-8d5b-4144-93e8-7b6f8728a8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.621362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660307-8d5b-4144-93e8-7b6f8728a8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.621643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660307-8d5b-4144-93e8-7b6f8728a8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.621918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660307-8d5b-4144-93e8-7b6f8728a8ec admin admin] PATH_INFO: `/v3/projects/c95214ea60544c9dac2e3296a69ffb05/users/f69c233833b74e1c8d9c9475c40fae56/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.623787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1056/2097] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:45.623905 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b660307-8d5b-4144-93e8-7b6f8728a8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95214ea60544c9dac2e3296a69ffb05, user_id=f69c233833b74e1c8d9c9475c40fae56, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.624564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20da61d-c8e9-4f99-926f-2b3ba1cfeb3c service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.625861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d20da61d-c8e9-4f99-926f-2b3ba1cfeb3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:45.626596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b660307-8d5b-4144-93e8-7b6f8728a8ec admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.633931 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:45.639297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1042/2098] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:45 2022] PUT /identity/v3/projects/c95214ea60544c9dac2e3296a69ffb05/users/f69c233833b74e1c8d9c9475c40fae56/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:45.650702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067a2b-4a5e-42fc-9861-09ee4394a530 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.651233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067a2b-4a5e-42fc-9861-09ee4394a530 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.651568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067a2b-4a5e-42fc-9861-09ee4394a530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.680800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bb067a2b-4a5e-42fc-9861-09ee4394a530 None None] MFA Rules not processed for user `f69c233833b74e1c8d9c9475c40fae56`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:45.682717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bb067a2b-4a5e-42fc-9861-09ee4394a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:45.698686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20da61d-c8e9-4f99-926f-2b3ba1cfeb3c service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.761559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410aa3-f463-4da0-8063-1c8b9ef5262d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.762606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410aa3-f463-4da0-8063-1c8b9ef5262d service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.763102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410aa3-f463-4da0-8063-1c8b9ef5262d service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.763589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69410aa3-f463-4da0-8063-1c8b9ef5262d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.778881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1043/2099] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:45.787001 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067a2b-4a5e-42fc-9861-09ee4394a530 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.788841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bb067a2b-4a5e-42fc-9861-09ee4394a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:45.802390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067a2b-4a5e-42fc-9861-09ee4394a530 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:45.806507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688dcd1-4d5e-4cd9-8022-df3c6bda0910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:45.807116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688dcd1-4d5e-4cd9-8022-df3c6bda0910 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:45.807407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688dcd1-4d5e-4cd9-8022-df3c6bda0910 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:45.807679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688dcd1-4d5e-4cd9-8022-df3c6bda0910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:45.818884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688dcd1-4d5e-4cd9-8022-df3c6bda0910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.820356 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3688dcd1-4d5e-4cd9-8022-df3c6bda0910 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.832078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1044/2100] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:45.835311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69410aa3-f463-4da0-8063-1c8b9ef5262d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:45.836880 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69410aa3-f463-4da0-8063-1c8b9ef5262d service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:45.848475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1057/2101] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:45.997071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688dcd1-4d5e-4cd9-8022-df3c6bda0910 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:45.999141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3688dcd1-4d5e-4cd9-8022-df3c6bda0910 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:46.111759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688dcd1-4d5e-4cd9-8022-df3c6bda0910 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:46.117551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:46.118383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:46.118589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:46.118825 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] PATH_INFO: `/v3/projects/54a2d2d065694da3b32cf6d8d2caa476` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:46.119998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a2d2d065694da3b32cf6d8d2caa476)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:46.121964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:46.214678 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a2d2d065694da3b32cf6d8d2caa476', 'request_id': 'req-c764729c-0813-4b1f-b73e-d27c3e895047'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.221416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a2d2d065694da3b32cf6d8d2caa476', 'request_id': 'req-c764729c-0813-4b1f-b73e-d27c3e895047'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.236369 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a2d2d065694da3b32cf6d8d2caa476', 'request_id': 'req-c764729c-0813-4b1f-b73e-d27c3e895047'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.245789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:46.249942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] The token cache is being invalidate because project 54a2d2d065694da3b32cf6d8d2caa476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:46.250267 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.251669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.253193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1045/2102] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:45 2022] DELETE /identity/v3/projects/54a2d2d065694da3b32cf6d8d2caa476 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:46.257909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410aa3-f463-4da0-8063-1c8b9ef5262d service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:46.263712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:46.269799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69410aa3-f463-4da0-8063-1c8b9ef5262d service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:46.332160 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:46.332927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:46.333327 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:46.333660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] PATH_INFO: `/v3/users/4bdee6f127c743758aebe4d3e7473cb8` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:46.334879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bdee6f127c743758aebe4d3e7473cb8)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:46.336860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:46.392714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bdee6f127c743758aebe4d3e7473cb8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.402566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bdee6f127c743758aebe4d3e7473cb8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.415261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bdee6f127c743758aebe4d3e7473cb8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.422960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bdee6f127c743758aebe4d3e7473cb8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.423624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bdee6f127c743758aebe4d3e7473cb8'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.430392 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1058/2103] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:46 2022] DELETE /identity/v3/users/4bdee6f127c743758aebe4d3e7473cb8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:46.571904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:46.573347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:46.587217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764729c-0813-4b1f-b73e-d27c3e895047 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:46.651842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52911f-5e32-4258-bb8e-9943e29ed7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:46.652476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52911f-5e32-4258-bb8e-9943e29ed7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:46.652759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52911f-5e32-4258-bb8e-9943e29ed7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:46.653033 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52911f-5e32-4258-bb8e-9943e29ed7e2 admin admin] PATH_INFO: `/v3/users/2d761936840644d696cf6825914ad584` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:46.654215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52911f-5e32-4258-bb8e-9943e29ed7e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d761936840644d696cf6825914ad584)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:46.656154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52911f-5e32-4258-bb8e-9943e29ed7e2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:46.706227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fa52911f-5e32-4258-bb8e-9943e29ed7e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d761936840644d696cf6825914ad584'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.707534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fa52911f-5e32-4258-bb8e-9943e29ed7e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d761936840644d696cf6825914ad584'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.708170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fa52911f-5e32-4258-bb8e-9943e29ed7e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d761936840644d696cf6825914ad584'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.716036 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fa52911f-5e32-4258-bb8e-9943e29ed7e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d761936840644d696cf6825914ad584'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.723674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fa52911f-5e32-4258-bb8e-9943e29ed7e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d761936840644d696cf6825914ad584'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.724317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:46.726133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:46.740314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec55b8-b1b8-42d6-a185-dd46ada7b37c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:46.745096 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:46.745886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:46.746212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:46.746490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] PATH_INFO: `/v3/projects/1efecf2303194b9ca760d972794985ee` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:46.747672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1efecf2303194b9ca760d972794985ee)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:46.749601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:46.751605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1046/2104] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:46 2022] DELETE /identity/v3/users/2d761936840644d696cf6825914ad584 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:46.757029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc603f6-ac6f-4cfe-b190-31827deb6ca1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:46.757419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc603f6-ac6f-4cfe-b190-31827deb6ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:46.757702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc603f6-ac6f-4cfe-b190-31827deb6ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:46.777202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2bc603f6-ac6f-4cfe-b190-31827deb6ca1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:46.778856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2bc603f6-ac6f-4cfe-b190-31827deb6ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:46.802220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1efecf2303194b9ca760d972794985ee', 'request_id': 'req-77150475-a816-4486-8699-f8afd4ee5b06'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.808275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1efecf2303194b9ca760d972794985ee', 'request_id': 'req-77150475-a816-4486-8699-f8afd4ee5b06'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.815591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1efecf2303194b9ca760d972794985ee', 'request_id': 'req-77150475-a816-4486-8699-f8afd4ee5b06'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.828625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] The token cache is being invalidate because project 1efecf2303194b9ca760d972794985ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:46.828913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.829567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-77150475-a816-4486-8699-f8afd4ee5b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:46.831133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1059/2105] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:46 2022] DELETE /identity/v3/projects/1efecf2303194b9ca760d972794985ee => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:46.835963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168707ec-f000-469f-9b04-efb7424073be None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:46.836247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168707ec-f000-469f-9b04-efb7424073be None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:46.836785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168707ec-f000-469f-9b04-efb7424073be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:46.844643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:46.847951 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1047/2106] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:46.856656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-168707ec-f000-469f-9b04-efb7424073be None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:46.858640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-168707ec-f000-469f-9b04-efb7424073be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:46.858792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc603f6-ac6f-4cfe-b190-31827deb6ca1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:46.860083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2bc603f6-ac6f-4cfe-b190-31827deb6ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:46.882373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:46.919432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1060/2107] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:46.920968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc603f6-ac6f-4cfe-b190-31827deb6ca1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:46.927495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c713-4971-48e4-b425-8bf8d0a85874 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:46.927810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c713-4971-48e4-b425-8bf8d0a85874 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:46.928087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91c713-4971-48e4-b425-8bf8d0a85874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:46.947781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4f91c713-4971-48e4-b425-8bf8d0a85874 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:46.948990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4f91c713-4971-48e4-b425-8bf8d0a85874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:46.957500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1061/2108] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:46.961524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91c713-4971-48e4-b425-8bf8d0a85874 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:46.970726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91c713-4971-48e4-b425-8bf8d0a85874 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:46.975835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c899736-a7df-4acb-8212-e18ac0550a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:46.976440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c899736-a7df-4acb-8212-e18ac0550a13 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:46.976721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c899736-a7df-4acb-8212-e18ac0550a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:46.976992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c899736-a7df-4acb-8212-e18ac0550a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:46.977822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c899736-a7df-4acb-8212-e18ac0550a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:46.977951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c899736-a7df-4acb-8212-e18ac0550a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:46.979557 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c899736-a7df-4acb-8212-e18ac0550a13 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:46.982853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec87f4-a641-42ed-857a-e486c6f69e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:46.983536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec87f4-a641-42ed-857a-e486c6f69e3d service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:46.983887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec87f4-a641-42ed-857a-e486c6f69e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:46.984231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec87f4-a641-42ed-857a-e486c6f69e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:46.992453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1062/2109] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:23:46.994765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec87f4-a641-42ed-857a-e486c6f69e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:46.996274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec87f4-a641-42ed-857a-e486c6f69e3d service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:46.996853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c899736-a7df-4acb-8212-e18ac0550a13 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.007422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1048/2110] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:47.007591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c899736-a7df-4acb-8212-e18ac0550a13 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.013767 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc90ac2-f3c9-444a-bc5e-8f3bcc7d4d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.014587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc90ac2-f3c9-444a-bc5e-8f3bcc7d4d9e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.014730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc90ac2-f3c9-444a-bc5e-8f3bcc7d4d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.014942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc90ac2-f3c9-444a-bc5e-8f3bcc7d4d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.015568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc90ac2-f3c9-444a-bc5e-8f3bcc7d4d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.017478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc90ac2-f3c9-444a-bc5e-8f3bcc7d4d9e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:47.044673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1063/2111] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:46 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:47.048921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec87f4-a641-42ed-857a-e486c6f69e3d service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.059240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec87f4-a641-42ed-857a-e486c6f69e3d service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.118422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6dd35-76e1-4bc4-97ca-2ebdbf9f1377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.119034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6dd35-76e1-4bc4-97ca-2ebdbf9f1377 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.119320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6dd35-76e1-4bc4-97ca-2ebdbf9f1377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.119649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6dd35-76e1-4bc4-97ca-2ebdbf9f1377 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.120239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6dd35-76e1-4bc4-97ca-2ebdbf9f1377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.122177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6dd35-76e1-4bc4-97ca-2ebdbf9f1377 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:47.160539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1049/2112] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:47 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:47.161857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc90ac2-f3c9-444a-bc5e-8f3bcc7d4d9e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.174932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc90ac2-f3c9-444a-bc5e-8f3bcc7d4d9e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.180361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235f443-8772-4547-aa6c-1d4cb2e1bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.180973 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235f443-8772-4547-aa6c-1d4cb2e1bf33 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.181252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235f443-8772-4547-aa6c-1d4cb2e1bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.181549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235f443-8772-4547-aa6c-1d4cb2e1bf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.182227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235f443-8772-4547-aa6c-1d4cb2e1bf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.183837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235f443-8772-4547-aa6c-1d4cb2e1bf33 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:47.194288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1064/2113] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:47.198005 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6dd35-76e1-4bc4-97ca-2ebdbf9f1377 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.209039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6dd35-76e1-4bc4-97ca-2ebdbf9f1377 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.214805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da05a6-f321-4f58-8fae-5ebd4128e9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.215400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da05a6-f321-4f58-8fae-5ebd4128e9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.215687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da05a6-f321-4f58-8fae-5ebd4128e9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.215916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da05a6-f321-4f58-8fae-5ebd4128e9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.216951 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da05a6-f321-4f58-8fae-5ebd4128e9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.218508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da05a6-f321-4f58-8fae-5ebd4128e9b1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:47.242092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1050/2114] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:47.246003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235f443-8772-4547-aa6c-1d4cb2e1bf33 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.256684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235f443-8772-4547-aa6c-1d4cb2e1bf33 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.262600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e770815-69ec-431a-a507-674f5a949a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.263165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770815-69ec-431a-a507-674f5a949a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.263471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770815-69ec-431a-a507-674f5a949a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.263732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e770815-69ec-431a-a507-674f5a949a6e admin admin] PATH_INFO: `/v3/projects/2a01db8121c94b0c814d563ac31f729b/users/344080ed01e34ebba67ec1991626d376/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.283714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e770815-69ec-431a-a507-674f5a949a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a01db8121c94b0c814d563ac31f729b, user_id=344080ed01e34ebba67ec1991626d376, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.287351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e770815-69ec-431a-a507-674f5a949a6e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:47.314081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1065/2115] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:47 2022] PUT /identity/v3/projects/2a01db8121c94b0c814d563ac31f729b/users/344080ed01e34ebba67ec1991626d376/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:47.321086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5138ae8-6efc-4e66-adb9-07a0397dc239 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.321448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5138ae8-6efc-4e66-adb9-07a0397dc239 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.321794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5138ae8-6efc-4e66-adb9-07a0397dc239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.353886 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f5138ae8-6efc-4e66-adb9-07a0397dc239 None None] MFA Rules not processed for user `344080ed01e34ebba67ec1991626d376`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:47.355401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f5138ae8-6efc-4e66-adb9-07a0397dc239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:47.386645 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e770815-69ec-431a-a507-674f5a949a6e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.389175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6e770815-69ec-431a-a507-674f5a949a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:47.424561 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:47.453978 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1051/2116] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:47.460697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5138ae8-6efc-4e66-adb9-07a0397dc239 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.479836 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e770815-69ec-431a-a507-674f5a949a6e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.484748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.485388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.485671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.486084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] PATH_INFO: `/v3/projects/1d52a25f2e354462bd8c2e74b03e19c2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.487175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d52a25f2e354462bd8c2e74b03e19c2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.489762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:47.538401 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:47.548293 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5138ae8-6efc-4e66-adb9-07a0397dc239 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.555503 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d52a25f2e354462bd8c2e74b03e19c2', 'request_id': 'req-23ee1dec-f7a8-4931-bf1d-910374536e65'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:47.561082 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d52a25f2e354462bd8c2e74b03e19c2', 'request_id': 'req-23ee1dec-f7a8-4931-bf1d-910374536e65'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:47.572654 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d52a25f2e354462bd8c2e74b03e19c2', 'request_id': 'req-23ee1dec-f7a8-4931-bf1d-910374536e65'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:47.584358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] The token cache is being invalidate because project 1d52a25f2e354462bd8c2e74b03e19c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:47.584657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:47.585318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:47.586863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1066/2117] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:47 2022] DELETE /identity/v3/projects/1d52a25f2e354462bd8c2e74b03e19c2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:47.590876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.592269 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:47.619598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacc2a2-762c-4c0b-acac-fa0141ad0c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.620343 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacc2a2-762c-4c0b-acac-fa0141ad0c00 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.620621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacc2a2-762c-4c0b-acac-fa0141ad0c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.620907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacc2a2-762c-4c0b-acac-fa0141ad0c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.621525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacc2a2-762c-4c0b-acac-fa0141ad0c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.623481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacc2a2-762c-4c0b-acac-fa0141ad0c00 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:47.651394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1052/2118] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:47 2022] POST /identity/v3/projects => generated 401 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:47.655579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacc2a2-762c-4c0b-acac-fa0141ad0c00 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.657384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-beacc2a2-762c-4c0b-acac-fa0141ad0c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:47.659047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1dec-f7a8-4931-bf1d-910374536e65 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.718175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.718716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.719905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.720178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] PATH_INFO: `/v3/users/f69c233833b74e1c8d9c9475c40fae56` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.721332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69c233833b74e1c8d9c9475c40fae56)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.723620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:47.724608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacc2a2-762c-4c0b-acac-fa0141ad0c00 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.730048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1230e9-1b58-4803-95a3-1b294db540a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.730287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1230e9-1b58-4803-95a3-1b294db540a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.730438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1230e9-1b58-4803-95a3-1b294db540a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.730713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1230e9-1b58-4803-95a3-1b294db540a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.731341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1230e9-1b58-4803-95a3-1b294db540a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.733382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1230e9-1b58-4803-95a3-1b294db540a4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:47.756675 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1053/2119] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:47 2022] POST /identity/v3/users => generated 307 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:47.761329 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1230e9-1b58-4803-95a3-1b294db540a4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.771039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1230e9-1b58-4803-95a3-1b294db540a4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.773871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69c233833b74e1c8d9c9475c40fae56'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:47.776061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54381ce-dc5d-49c2-81ba-1fdac62eb416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.777000 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54381ce-dc5d-49c2-81ba-1fdac62eb416 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.777279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54381ce-dc5d-49c2-81ba-1fdac62eb416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.777603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54381ce-dc5d-49c2-81ba-1fdac62eb416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.778274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54381ce-dc5d-49c2-81ba-1fdac62eb416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.780312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54381ce-dc5d-49c2-81ba-1fdac62eb416 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:47.781444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69c233833b74e1c8d9c9475c40fae56'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:47.782591 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:47.789608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:47.794869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69c233833b74e1c8d9c9475c40fae56'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:47.799761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1054/2120] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:47.801813 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54381ce-dc5d-49c2-81ba-1fdac62eb416 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.803635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69c233833b74e1c8d9c9475c40fae56'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:47.804331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69c233833b74e1c8d9c9475c40fae56'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:47.810606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1067/2121] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:47 2022] DELETE /identity/v3/users/f69c233833b74e1c8d9c9475c40fae56 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:47.815827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54381ce-dc5d-49c2-81ba-1fdac62eb416 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.879756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2b167-5e87-403f-ba94-5eeeff6c291d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.880458 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b167-5e87-403f-ba94-5eeeff6c291d admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.880743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b167-5e87-403f-ba94-5eeeff6c291d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.881017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b167-5e87-403f-ba94-5eeeff6c291d admin admin] PATH_INFO: `/v3/projects/1f238ef220ae46fb8992252b317136c9/users/e4b37446891141d48e02e37583f8a77f/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.895921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2b167-5e87-403f-ba94-5eeeff6c291d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f238ef220ae46fb8992252b317136c9, user_id=e4b37446891141d48e02e37583f8a77f, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.898637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2b167-5e87-403f-ba94-5eeeff6c291d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:47.912264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1055/2122] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:47 2022] PUT /identity/v3/projects/1f238ef220ae46fb8992252b317136c9/users/e4b37446891141d48e02e37583f8a77f/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:47.916228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:47.917774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:47.931972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2dce-df89-4362-878c-7a4f0796457d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:47.995688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eca23-63d2-471a-bee5-16393bc04788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:47.996302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eca23-63d2-471a-bee5-16393bc04788 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:47.996579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eca23-63d2-471a-bee5-16393bc04788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:47.996894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eca23-63d2-471a-bee5-16393bc04788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:47.997539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eca23-63d2-471a-bee5-16393bc04788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:47.999160 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eca23-63d2-471a-bee5-16393bc04788 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:48.009617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1068/2123] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:48.013702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2b167-5e87-403f-ba94-5eeeff6c291d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:48.025261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2b167-5e87-403f-ba94-5eeeff6c291d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:48.030063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644135c-3739-4b5f-a614-7bc343959c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:48.030728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644135c-3739-4b5f-a614-7bc343959c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.031011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644135c-3739-4b5f-a614-7bc343959c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.031311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644135c-3739-4b5f-a614-7bc343959c44 admin admin] PATH_INFO: `/v3/projects/1f238ef220ae46fb8992252b317136c9/users/e4b37446891141d48e02e37583f8a77f/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.033197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644135c-3739-4b5f-a614-7bc343959c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f238ef220ae46fb8992252b317136c9, user_id=e4b37446891141d48e02e37583f8a77f, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:48.036406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644135c-3739-4b5f-a614-7bc343959c44 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:48.047856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1056/2124] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:48 2022] PUT /identity/v3/projects/1f238ef220ae46fb8992252b317136c9/users/e4b37446891141d48e02e37583f8a77f/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:48.058549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6fbe2-5664-43e9-a6ad-15665b36d3a0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.058835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6fbe2-5664-43e9-a6ad-15665b36d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.059110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6fbe2-5664-43e9-a6ad-15665b36d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.087217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4fe6fbe2-5664-43e9-a6ad-15665b36d3a0 None None] MFA Rules not processed for user `e4b37446891141d48e02e37583f8a77f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:48.088454 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4fe6fbe2-5664-43e9-a6ad-15665b36d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:48.111171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644135c-3739-4b5f-a614-7bc343959c44 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:48.115038 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8644135c-3739-4b5f-a614-7bc343959c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:48.168473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1069/2125] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:48 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:48.182500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6fbe2-5664-43e9-a6ad-15665b36d3a0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:48.183967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4fe6fbe2-5664-43e9-a6ad-15665b36d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:48.187205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644135c-3739-4b5f-a614-7bc343959c44 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:48.192143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:48.192777 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.193135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.193401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] PATH_INFO: `/v3/projects/c95214ea60544c9dac2e3296a69ffb05` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.194579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95214ea60544c9dac2e3296a69ffb05)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:48.196509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:48.246587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6fbe2-5664-43e9-a6ad-15665b36d3a0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:48.252792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95214ea60544c9dac2e3296a69ffb05', 'request_id': 'req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:48.261323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95214ea60544c9dac2e3296a69ffb05', 'request_id': 'req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:48.264402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:48.271139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95214ea60544c9dac2e3296a69ffb05', 'request_id': 'req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:48.289578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:48.295080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] The token cache is being invalidate because project c95214ea60544c9dac2e3296a69ffb05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:48.295944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:48.297977 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-4d768aec-3dbb-4ea9-8ae4-ff79c06a653f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:48.300228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1057/2126] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:48 2022] DELETE /identity/v3/projects/c95214ea60544c9dac2e3296a69ffb05 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:48.305398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3518a-9769-46d4-b755-3489cf7a989c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.306337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3518a-9769-46d4-b755-3489cf7a989c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.307037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3518a-9769-46d4-b755-3489cf7a989c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.317995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42456dba-4a0d-4b04-86be-1a25061f05fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:48.319188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42456dba-4a0d-4b04-86be-1a25061f05fd service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.320334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42456dba-4a0d-4b04-86be-1a25061f05fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.320613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42456dba-4a0d-4b04-86be-1a25061f05fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.322433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-42456dba-4a0d-4b04-86be-1a25061f05fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:48.340554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-abe3518a-9769-46d4-b755-3489cf7a989c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:48.342375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-abe3518a-9769-46d4-b755-3489cf7a989c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:48.394508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42456dba-4a0d-4b04-86be-1a25061f05fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:48.396084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42456dba-4a0d-4b04-86be-1a25061f05fd service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:48.405689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1070/2127] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:48 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:48.410356 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1058/2128] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:48.418954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef152000-87ae-4958-b5c0-9b55944474c7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.419240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef152000-87ae-4958-b5c0-9b55944474c7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.419512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef152000-87ae-4958-b5c0-9b55944474c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.440107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ef152000-87ae-4958-b5c0-9b55944474c7 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:48.441476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef152000-87ae-4958-b5c0-9b55944474c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:48.450313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1071/2129] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:48.454171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3518a-9769-46d4-b755-3489cf7a989c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:48.464895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3518a-9769-46d4-b755-3489cf7a989c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:48.469801 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3d3bf-5bb6-40b0-8883-77723cc1bfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:48.470305 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d3bf-5bb6-40b0-8883-77723cc1bfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.474229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d3bf-5bb6-40b0-8883-77723cc1bfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.474229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d3bf-5bb6-40b0-8883-77723cc1bfb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.474229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3d3bf-5bb6-40b0-8883-77723cc1bfb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:48.474229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3d3bf-5bb6-40b0-8883-77723cc1bfb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:48.474485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3d3bf-5bb6-40b0-8883-77723cc1bfb5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:48.489526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1059/2130] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:48.493887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef152000-87ae-4958-b5c0-9b55944474c7 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:48.494075 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3d3bf-5bb6-40b0-8883-77723cc1bfb5 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:48.495424 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef152000-87ae-4958-b5c0-9b55944474c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:48.503914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3d3bf-5bb6-40b0-8883-77723cc1bfb5 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:48.508034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef152000-87ae-4958-b5c0-9b55944474c7 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:48.508876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960462d4-3bb2-424a-96ff-332f116c3e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:48.509491 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960462d4-3bb2-424a-96ff-332f116c3e1b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.509771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960462d4-3bb2-424a-96ff-332f116c3e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.510064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960462d4-3bb2-424a-96ff-332f116c3e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.510700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960462d4-3bb2-424a-96ff-332f116c3e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:48.512604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960462d4-3bb2-424a-96ff-332f116c3e1b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:48.514363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322860b-4928-44b9-ade3-86034268c809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:48.515061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322860b-4928-44b9-ade3-86034268c809 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.515343 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322860b-4928-44b9-ade3-86034268c809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.515623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322860b-4928-44b9-ade3-86034268c809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.517465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d322860b-4928-44b9-ade3-86034268c809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:48.563706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1060/2131] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:48 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:48.567689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960462d4-3bb2-424a-96ff-332f116c3e1b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:48.605636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322860b-4928-44b9-ade3-86034268c809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:48.607299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322860b-4928-44b9-ade3-86034268c809 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:48.617986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1072/2132] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:48.646203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960462d4-3bb2-424a-96ff-332f116c3e1b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:48.652022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c06e7-1b5c-497e-ab83-35e789db9b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:48.652630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c06e7-1b5c-497e-ab83-35e789db9b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.652914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c06e7-1b5c-497e-ab83-35e789db9b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.653190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c06e7-1b5c-497e-ab83-35e789db9b2a admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.653843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c06e7-1b5c-497e-ab83-35e789db9b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:48.656021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c06e7-1b5c-497e-ab83-35e789db9b2a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:48.683389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1061/2133] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:48 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:48.684664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322860b-4928-44b9-ade3-86034268c809 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:48.701297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322860b-4928-44b9-ade3-86034268c809 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:48.711912 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfde62-2114-4ced-8610-20a7615e9772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:48.712575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfde62-2114-4ced-8610-20a7615e9772 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.712843 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfde62-2114-4ced-8610-20a7615e9772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.713115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfde62-2114-4ced-8610-20a7615e9772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.713874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfde62-2114-4ced-8610-20a7615e9772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:48.716573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfde62-2114-4ced-8610-20a7615e9772 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:48.740900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1073/2134] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:48.742157 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c06e7-1b5c-497e-ab83-35e789db9b2a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:48.753998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c06e7-1b5c-497e-ab83-35e789db9b2a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:48.759816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46895cc-cdd6-49d3-9ec6-948384e6cd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:48.760429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46895cc-cdd6-49d3-9ec6-948384e6cd63 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.760719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46895cc-cdd6-49d3-9ec6-948384e6cd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.761023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46895cc-cdd6-49d3-9ec6-948384e6cd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.761931 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46895cc-cdd6-49d3-9ec6-948384e6cd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:48.764243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46895cc-cdd6-49d3-9ec6-948384e6cd63 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:48.777372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1062/2135] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:48.783662 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfde62-2114-4ced-8610-20a7615e9772 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:48.799523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfde62-2114-4ced-8610-20a7615e9772 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:48.804700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247a767-4a3e-495f-a138-cca06f98f792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:48.805393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247a767-4a3e-495f-a138-cca06f98f792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.805719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247a767-4a3e-495f-a138-cca06f98f792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.805923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247a767-4a3e-495f-a138-cca06f98f792 admin admin] PATH_INFO: `/v3/projects/7d815820d34347989c945b717534b9d1/users/481dc515d0094724a978e07c261372e0/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.823277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247a767-4a3e-495f-a138-cca06f98f792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d815820d34347989c945b717534b9d1, user_id=481dc515d0094724a978e07c261372e0, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:48.829092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247a767-4a3e-495f-a138-cca06f98f792 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:48.845198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1074/2136] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:48 2022] PUT /identity/v3/projects/7d815820d34347989c945b717534b9d1/users/481dc515d0094724a978e07c261372e0/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:48.856494 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01faf-32de-42e1-804a-7a3c11540bc7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:48.856852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01faf-32de-42e1-804a-7a3c11540bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:48.857362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb01faf-32de-42e1-804a-7a3c11540bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:48.895125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8cb01faf-32de-42e1-804a-7a3c11540bc7 None None] MFA Rules not processed for user `481dc515d0094724a978e07c261372e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:48.896363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8cb01faf-32de-42e1-804a-7a3c11540bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:48.937744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:48.983337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1063/2137] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:48.988616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247a767-4a3e-495f-a138-cca06f98f792 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:49.028948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:49.062324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247a767-4a3e-495f-a138-cca06f98f792 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:49.067260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9730c24-006c-4de6-8661-f374cba1dde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:49.067872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9730c24-006c-4de6-8661-f374cba1dde3 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.068148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9730c24-006c-4de6-8661-f374cba1dde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.068419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9730c24-006c-4de6-8661-f374cba1dde3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.069050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9730c24-006c-4de6-8661-f374cba1dde3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:49.070972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9730c24-006c-4de6-8661-f374cba1dde3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:49.096882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1075/2138] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:48 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:49.101853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb01faf-32de-42e1-804a-7a3c11540bc7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:49.112641 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb01faf-32de-42e1-804a-7a3c11540bc7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:49.168350 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2cb04-2e4f-4079-891f-7f098b69148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:49.168956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2cb04-2e4f-4079-891f-7f098b69148c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.169235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2cb04-2e4f-4079-891f-7f098b69148c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.169503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2cb04-2e4f-4079-891f-7f098b69148c admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.170163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2cb04-2e4f-4079-891f-7f098b69148c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:49.172051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2cb04-2e4f-4079-891f-7f098b69148c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:49.192624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1064/2139] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:49 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:49.196716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9730c24-006c-4de6-8661-f374cba1dde3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:49.207653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9730c24-006c-4de6-8661-f374cba1dde3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:49.212240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31f5e4-aff6-4692-9507-1a719cbb91ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:49.212822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f5e4-aff6-4692-9507-1a719cbb91ae admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.213100 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f5e4-aff6-4692-9507-1a719cbb91ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.213370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f5e4-aff6-4692-9507-1a719cbb91ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.214002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31f5e4-aff6-4692-9507-1a719cbb91ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:49.215623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31f5e4-aff6-4692-9507-1a719cbb91ae admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:49.226942 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1076/2140] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:49.230812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2cb04-2e4f-4079-891f-7f098b69148c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:49.240465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2cb04-2e4f-4079-891f-7f098b69148c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:49.244971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2b4f3-9c98-4625-843e-9d84340356f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:49.245552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2b4f3-9c98-4625-843e-9d84340356f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.245829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2b4f3-9c98-4625-843e-9d84340356f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.246135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2b4f3-9c98-4625-843e-9d84340356f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.246766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2b4f3-9c98-4625-843e-9d84340356f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:49.248339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2b4f3-9c98-4625-843e-9d84340356f0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:49.257945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1065/2141] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:49.261976 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31f5e4-aff6-4692-9507-1a719cbb91ae admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:49.272426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31f5e4-aff6-4692-9507-1a719cbb91ae admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:49.277056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169859-265d-440a-a99e-e26d2e01371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:49.277745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169859-265d-440a-a99e-e26d2e01371c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.278017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169859-265d-440a-a99e-e26d2e01371c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.278322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8169859-265d-440a-a99e-e26d2e01371c admin admin] PATH_INFO: `/v3/projects/ca04091dbc784625a41f13e58e96db4c/users/394db0e113494d5f93eedf799f721a97/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.293027 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8169859-265d-440a-a99e-e26d2e01371c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca04091dbc784625a41f13e58e96db4c, user_id=394db0e113494d5f93eedf799f721a97, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:49.295732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8169859-265d-440a-a99e-e26d2e01371c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:49.307946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1077/2142] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:49 2022] PUT /identity/v3/projects/ca04091dbc784625a41f13e58e96db4c/users/394db0e113494d5f93eedf799f721a97/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:49.319075 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528372e3-0806-4ef4-8086-2cbcef7ecbc6 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.319366 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528372e3-0806-4ef4-8086-2cbcef7ecbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.319643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528372e3-0806-4ef4-8086-2cbcef7ecbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.351719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-528372e3-0806-4ef4-8086-2cbcef7ecbc6 None None] MFA Rules not processed for user `394db0e113494d5f93eedf799f721a97`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:49.353016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-528372e3-0806-4ef4-8086-2cbcef7ecbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:49.426361 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1066/2143] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:49.430896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169859-265d-440a-a99e-e26d2e01371c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:49.516557 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8169859-265d-440a-a99e-e26d2e01371c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:49.522850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362558-019c-4c7c-882a-2b0bc18811d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:49.523469 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362558-019c-4c7c-882a-2b0bc18811d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.523753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362558-019c-4c7c-882a-2b0bc18811d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.524029 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362558-019c-4c7c-882a-2b0bc18811d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.524665 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9362558-019c-4c7c-882a-2b0bc18811d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:49.526761 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9362558-019c-4c7c-882a-2b0bc18811d5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:49.559242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1078/2144] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:49 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:49.560277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528372e3-0806-4ef4-8086-2cbcef7ecbc6 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:49.572676 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528372e3-0806-4ef4-8086-2cbcef7ecbc6 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:49.614808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:49.636212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac83088-9c42-46f5-97e0-ef3ead2ab10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:49.636822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac83088-9c42-46f5-97e0-ef3ead2ab10f admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.637106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac83088-9c42-46f5-97e0-ef3ead2ab10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.637496 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac83088-9c42-46f5-97e0-ef3ead2ab10f admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.638170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac83088-9c42-46f5-97e0-ef3ead2ab10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:49.640108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac83088-9c42-46f5-97e0-ef3ead2ab10f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:49.674614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1067/2145] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:49 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:49.678561 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362558-019c-4c7c-882a-2b0bc18811d5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:49.689966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362558-019c-4c7c-882a-2b0bc18811d5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:49.695889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd3cf-d435-4483-ac6a-96c29855cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:49.699058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd3cf-d435-4483-ac6a-96c29855cb29 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.699058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd3cf-d435-4483-ac6a-96c29855cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.699058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd3cf-d435-4483-ac6a-96c29855cb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.699058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dd3cf-d435-4483-ac6a-96c29855cb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:49.699870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dd3cf-d435-4483-ac6a-96c29855cb29 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:49.715848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1079/2146] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:49.717202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac83088-9c42-46f5-97e0-ef3ead2ab10f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:49.729734 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac83088-9c42-46f5-97e0-ef3ead2ab10f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:49.735089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aba8b0-162c-41f8-b5df-0c1adc983efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:49.735751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aba8b0-162c-41f8-b5df-0c1adc983efb admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.736022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aba8b0-162c-41f8-b5df-0c1adc983efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.736291 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aba8b0-162c-41f8-b5df-0c1adc983efb admin admin] PATH_INFO: `/v3/projects/235ada38c83441e9b5f932b718370a91/users/e4f9f4bac747418d9d40ffd71d07fb28/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.753228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aba8b0-162c-41f8-b5df-0c1adc983efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=235ada38c83441e9b5f932b718370a91, user_id=e4f9f4bac747418d9d40ffd71d07fb28, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:49.756443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aba8b0-162c-41f8-b5df-0c1adc983efb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:49.770152 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1068/2147] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:49 2022] PUT /identity/v3/projects/235ada38c83441e9b5f932b718370a91/users/e4f9f4bac747418d9d40ffd71d07fb28/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:49.774185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd3cf-d435-4483-ac6a-96c29855cb29 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:49.784938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd3cf-d435-4483-ac6a-96c29855cb29 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:49.837099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:49.847010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7e64d-86d6-4c35-99e9-f439a8b07ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:49.847616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7e64d-86d6-4c35-99e9-f439a8b07ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.847920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7e64d-86d6-4c35-99e9-f439a8b07ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.848427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7e64d-86d6-4c35-99e9-f439a8b07ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.849097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7e64d-86d6-4c35-99e9-f439a8b07ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:49.850687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7e64d-86d6-4c35-99e9-f439a8b07ce2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:49.860526 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1080/2148] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:49.865603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aba8b0-162c-41f8-b5df-0c1adc983efb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:49.876742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aba8b0-162c-41f8-b5df-0c1adc983efb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:49.882573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779950c-89f3-4013-b540-1413cf27dbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:49.883288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779950c-89f3-4013-b540-1413cf27dbb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.883635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779950c-89f3-4013-b540-1413cf27dbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.883973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779950c-89f3-4013-b540-1413cf27dbb0 admin admin] PATH_INFO: `/v3/projects/235ada38c83441e9b5f932b718370a91/users/e4f9f4bac747418d9d40ffd71d07fb28/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.885967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779950c-89f3-4013-b540-1413cf27dbb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=235ada38c83441e9b5f932b718370a91, user_id=e4f9f4bac747418d9d40ffd71d07fb28, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:49.888935 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779950c-89f3-4013-b540-1413cf27dbb0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:49.900304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1069/2149] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:49 2022] PUT /identity/v3/projects/235ada38c83441e9b5f932b718370a91/users/e4f9f4bac747418d9d40ffd71d07fb28/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:49.910393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf05e2-6df3-469f-a300-44961d7acc68 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:49.911165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf05e2-6df3-469f-a300-44961d7acc68 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:49.911442 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf05e2-6df3-469f-a300-44961d7acc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:49.942791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8ccf05e2-6df3-469f-a300-44961d7acc68 None None] MFA Rules not processed for user `e4f9f4bac747418d9d40ffd71d07fb28`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:49.944077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8ccf05e2-6df3-469f-a300-44961d7acc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:50.016126 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1081/2150] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:50.030364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779950c-89f3-4013-b540-1413cf27dbb0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:50.093203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779950c-89f3-4013-b540-1413cf27dbb0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:50.097414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabd33f-87c7-46bc-997b-8b7967b88c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:50.098129 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabd33f-87c7-46bc-997b-8b7967b88c2b service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:50.098684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabd33f-87c7-46bc-997b-8b7967b88c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:50.098945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabd33f-87c7-46bc-997b-8b7967b88c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:50.157334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabd33f-87c7-46bc-997b-8b7967b88c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:50.158799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabd33f-87c7-46bc-997b-8b7967b88c2b service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:50.168947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1070/2151] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:51.780667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf05e2-6df3-469f-a300-44961d7acc68 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:51.782162 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8ccf05e2-6df3-469f-a300-44961d7acc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:51.794702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf05e2-6df3-469f-a300-44961d7acc68 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:51.799281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec66f76-1fa4-49b3-b812-b86e606f67b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:51.800219 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec66f76-1fa4-49b3-b812-b86e606f67b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:51.800588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec66f76-1fa4-49b3-b812-b86e606f67b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:51.801015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec66f76-1fa4-49b3-b812-b86e606f67b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:51.887787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec66f76-1fa4-49b3-b812-b86e606f67b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:51.889268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec66f76-1fa4-49b3-b812-b86e606f67b1 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:51.901825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1082/2152] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:52.518287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabd33f-87c7-46bc-997b-8b7967b88c2b service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:52.527173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabd33f-87c7-46bc-997b-8b7967b88c2b service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:52.530758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73ae27-6ff3-4bbd-b36d-fab7070d52de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:52.531352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ae27-6ff3-4bbd-b36d-fab7070d52de service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:52.531630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ae27-6ff3-4bbd-b36d-fab7070d52de service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:52.531899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ae27-6ff3-4bbd-b36d-fab7070d52de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:52.540674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73ae27-6ff3-4bbd-b36d-fab7070d52de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:52.542537 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73ae27-6ff3-4bbd-b36d-fab7070d52de service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:52.552252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1071/2153] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:52.851395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec66f76-1fa4-49b3-b812-b86e606f67b1 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:52.852844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-aec66f76-1fa4-49b3-b812-b86e606f67b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:52.926203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec66f76-1fa4-49b3-b812-b86e606f67b1 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:52.931206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:52.931835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:52.932126 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:52.932396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] PATH_INFO: `/v3/users/344080ed01e34ebba67ec1991626d376` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:52.933513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] RBAC: Authorizing `identity:delete_user(user_id=344080ed01e34ebba67ec1991626d376)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:52.935454 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:52.957307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:53.002896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344080ed01e34ebba67ec1991626d376'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.010551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344080ed01e34ebba67ec1991626d376'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.022548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344080ed01e34ebba67ec1991626d376'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.030555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344080ed01e34ebba67ec1991626d376'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.031217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344080ed01e34ebba67ec1991626d376'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.037324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1083/2154] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:52 2022] DELETE /identity/v3/users/344080ed01e34ebba67ec1991626d376 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:53.042198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474eaa5-bbe8-4331-8cab-ef101a8ff1cd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:53.042198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474eaa5-bbe8-4331-8cab-ef101a8ff1cd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:53.042476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474eaa5-bbe8-4331-8cab-ef101a8ff1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:53.061842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d474eaa5-bbe8-4331-8cab-ef101a8ff1cd None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:53.063076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d474eaa5-bbe8-4331-8cab-ef101a8ff1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:53.093027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:53.127795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1072/2155] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:53.137959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:53.139439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:53.198554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1965d-367e-4bb4-99b7-59154d71292d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:53.202267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b2f72-a079-4681-9a0e-0a0287471444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:53.202873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b2f72-a079-4681-9a0e-0a0287471444 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:53.203147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b2f72-a079-4681-9a0e-0a0287471444 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:53.203417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b2f72-a079-4681-9a0e-0a0287471444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:53.212763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b2f72-a079-4681-9a0e-0a0287471444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:53.215192 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b2f72-a079-4681-9a0e-0a0287471444 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:53.227528 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1084/2156] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:53.518390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474eaa5-bbe8-4331-8cab-ef101a8ff1cd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:53.521025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d474eaa5-bbe8-4331-8cab-ef101a8ff1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:53.534089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474eaa5-bbe8-4331-8cab-ef101a8ff1cd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:53.540308 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:53.541337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:53.541850 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:53.542367 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] PATH_INFO: `/v3/projects/2a01db8121c94b0c814d563ac31f729b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:53.543723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a01db8121c94b0c814d563ac31f729b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:53.545929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:53.613083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a01db8121c94b0c814d563ac31f729b', 'request_id': 'req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.619093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a01db8121c94b0c814d563ac31f729b', 'request_id': 'req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.626492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a01db8121c94b0c814d563ac31f729b', 'request_id': 'req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.637547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] The token cache is being invalidate because project 2a01db8121c94b0c814d563ac31f729b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:53.637839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.638517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.640055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1073/2157] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:53 2022] DELETE /identity/v3/projects/2a01db8121c94b0c814d563ac31f729b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:53.644706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b2f72-a079-4681-9a0e-0a0287471444 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:53.654471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b2f72-a079-4681-9a0e-0a0287471444 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:53.714935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a1505-0c0a-498c-8912-d15bf1c8bae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:53.715567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a1505-0c0a-498c-8912-d15bf1c8bae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:53.715905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a1505-0c0a-498c-8912-d15bf1c8bae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:53.716228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a1505-0c0a-498c-8912-d15bf1c8bae8 admin admin] PATH_INFO: `/v3/users/e4b37446891141d48e02e37583f8a77f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:53.717670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a1505-0c0a-498c-8912-d15bf1c8bae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b37446891141d48e02e37583f8a77f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:53.719737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a1505-0c0a-498c-8912-d15bf1c8bae8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:53.758208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:53.770050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b12a1505-0c0a-498c-8912-d15bf1c8bae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b37446891141d48e02e37583f8a77f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.777620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b12a1505-0c0a-498c-8912-d15bf1c8bae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b37446891141d48e02e37583f8a77f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.791835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b12a1505-0c0a-498c-8912-d15bf1c8bae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b37446891141d48e02e37583f8a77f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.800103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b12a1505-0c0a-498c-8912-d15bf1c8bae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b37446891141d48e02e37583f8a77f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.800801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b12a1505-0c0a-498c-8912-d15bf1c8bae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b37446891141d48e02e37583f8a77f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:53.808158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1085/2158] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:53 2022] DELETE /identity/v3/users/e4b37446891141d48e02e37583f8a77f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:54.090965 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:54.092700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:54.112164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d63b5b-4f95-40ae-a062-f82a7cbbc136 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:54.193010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:54.193755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:54.194146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:54.194484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] PATH_INFO: `/v3/projects/1f238ef220ae46fb8992252b317136c9` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:54.195665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f238ef220ae46fb8992252b317136c9)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:54.197631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:54.252663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f238ef220ae46fb8992252b317136c9', 'request_id': 'req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:54.259360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f238ef220ae46fb8992252b317136c9', 'request_id': 'req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:54.261209 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:54.267557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f238ef220ae46fb8992252b317136c9', 'request_id': 'req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:54.281696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] The token cache is being invalidate because project 1f238ef220ae46fb8992252b317136c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:54.282004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:54.282747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b98b6b36-4d58-4d6d-b205-bbcaa021cf06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:54.284616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1074/2159] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:54 2022] DELETE /identity/v3/projects/1f238ef220ae46fb8992252b317136c9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:54.290281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d15c-ec5a-4db3-8d03-55bbf76f3422 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:54.290773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d15c-ec5a-4db3-8d03-55bbf76f3422 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:54.290869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15d15c-ec5a-4db3-8d03-55bbf76f3422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:54.311345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8a15d15c-ec5a-4db3-8d03-55bbf76f3422 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:54.312530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8a15d15c-ec5a-4db3-8d03-55bbf76f3422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:54.370477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1086/2160] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:54.378046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b25e-4b3b-4361-9356-33a1057412da None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:54.378354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b25e-4b3b-4361-9356-33a1057412da None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:54.378629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b25e-4b3b-4361-9356-33a1057412da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:54.399527 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9d39b25e-4b3b-4361-9356-33a1057412da None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:54.400729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9d39b25e-4b3b-4361-9356-33a1057412da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:54.408555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1075/2161] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:54.413312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15d15c-ec5a-4db3-8d03-55bbf76f3422 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:54.423124 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15d15c-ec5a-4db3-8d03-55bbf76f3422 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:54.428284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a682702-2f66-40bb-98a4-5463fa19b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:54.428915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682702-2f66-40bb-98a4-5463fa19b582 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:54.429195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682702-2f66-40bb-98a4-5463fa19b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:54.429461 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682702-2f66-40bb-98a4-5463fa19b582 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:54.430148 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a682702-2f66-40bb-98a4-5463fa19b582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:54.430482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a682702-2f66-40bb-98a4-5463fa19b582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:54.432125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a682702-2f66-40bb-98a4-5463fa19b582 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:54.443956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1087/2162] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:54.448321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39b25e-4b3b-4361-9356-33a1057412da None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:54.458130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39b25e-4b3b-4361-9356-33a1057412da None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:54.463023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cd971-2a18-46e8-9409-4601712819e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:54.463627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cd971-2a18-46e8-9409-4601712819e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:54.463904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cd971-2a18-46e8-9409-4601712819e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:54.464172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cd971-2a18-46e8-9409-4601712819e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:54.464798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cd971-2a18-46e8-9409-4601712819e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:54.466727 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cd971-2a18-46e8-9409-4601712819e9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:54.494179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1076/2163] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:54 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:54.498313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a682702-2f66-40bb-98a4-5463fa19b582 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:54.508380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a682702-2f66-40bb-98a4-5463fa19b582 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:54.564180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534ee6f-d14e-4878-9249-6d76eead0320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:54.564790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534ee6f-d14e-4878-9249-6d76eead0320 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:54.565071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534ee6f-d14e-4878-9249-6d76eead0320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:54.565345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534ee6f-d14e-4878-9249-6d76eead0320 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:54.565969 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534ee6f-d14e-4878-9249-6d76eead0320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:54.567892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534ee6f-d14e-4878-9249-6d76eead0320 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:54.589106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1088/2164] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:54 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:54.593248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cd971-2a18-46e8-9409-4601712819e9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:54.604628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cd971-2a18-46e8-9409-4601712819e9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:54.610008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a2489-de49-47f9-b0af-8446c75978ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:54.610703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2489-de49-47f9-b0af-8446c75978ea admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:54.611000 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2489-de49-47f9-b0af-8446c75978ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:54.611347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a2489-de49-47f9-b0af-8446c75978ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:54.612029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a2489-de49-47f9-b0af-8446c75978ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:54.613636 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a2489-de49-47f9-b0af-8446c75978ea admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:54.623572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1077/2165] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:54.627786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534ee6f-d14e-4878-9249-6d76eead0320 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:54.640003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534ee6f-d14e-4878-9249-6d76eead0320 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:54.645505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736c591-b341-4214-8917-9b73304d4ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:54.646150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736c591-b341-4214-8917-9b73304d4ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:54.646435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736c591-b341-4214-8917-9b73304d4ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:54.646711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736c591-b341-4214-8917-9b73304d4ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:54.647508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736c591-b341-4214-8917-9b73304d4ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:54.649415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736c591-b341-4214-8917-9b73304d4ab5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:54.661136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1089/2166] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:54.665509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a2489-de49-47f9-b0af-8446c75978ea admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:54.677010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a2489-de49-47f9-b0af-8446c75978ea admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:54.682009 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bb848-f33a-4a8d-9688-e26c92786750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:54.682699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb848-f33a-4a8d-9688-e26c92786750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:54.682984 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb848-f33a-4a8d-9688-e26c92786750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:54.683801 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb848-f33a-4a8d-9688-e26c92786750 admin admin] PATH_INFO: `/v3/projects/148b2bb6131e4cec8d020fe6ebab447e/users/bc4039297dec481ea1f353acf7cad247/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:54.702017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bb848-f33a-4a8d-9688-e26c92786750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=148b2bb6131e4cec8d020fe6ebab447e, user_id=bc4039297dec481ea1f353acf7cad247, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:54.704700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bb848-f33a-4a8d-9688-e26c92786750 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:54.718416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1078/2167] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:54 2022] PUT /identity/v3/projects/148b2bb6131e4cec8d020fe6ebab447e/users/bc4039297dec481ea1f353acf7cad247/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:54.730536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbdf7-ca08-4c2b-8841-a1cf4570900b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:54.730828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbdf7-ca08-4c2b-8841-a1cf4570900b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:54.731104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbdf7-ca08-4c2b-8841-a1cf4570900b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:54.762133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cfecbdf7-ca08-4c2b-8841-a1cf4570900b None None] MFA Rules not processed for user `bc4039297dec481ea1f353acf7cad247`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:54.763694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cfecbdf7-ca08-4c2b-8841-a1cf4570900b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:54.772644 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:54.842217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1090/2168] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:54.842481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bb848-f33a-4a8d-9688-e26c92786750 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:54.904609 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bb848-f33a-4a8d-9688-e26c92786750 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:54.909233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83048aaf-c8cd-4fae-bd20-bcc7e192f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:54.910389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83048aaf-c8cd-4fae-bd20-bcc7e192f242 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:54.910667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83048aaf-c8cd-4fae-bd20-bcc7e192f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:54.910936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83048aaf-c8cd-4fae-bd20-bcc7e192f242 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:54.911574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83048aaf-c8cd-4fae-bd20-bcc7e192f242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:54.913439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83048aaf-c8cd-4fae-bd20-bcc7e192f242 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:54.940469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1079/2169] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:54 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:54.944868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecbdf7-ca08-4c2b-8841-a1cf4570900b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:54.955946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecbdf7-ca08-4c2b-8841-a1cf4570900b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:55.020280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e13c3-7c1f-4b62-be61-0858e967d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:55.020895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e13c3-7c1f-4b62-be61-0858e967d345 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:55.021221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e13c3-7c1f-4b62-be61-0858e967d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:55.021496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e13c3-7c1f-4b62-be61-0858e967d345 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:55.022159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e13c3-7c1f-4b62-be61-0858e967d345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:55.024147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e13c3-7c1f-4b62-be61-0858e967d345 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:55.046136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1091/2170] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:54 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:55.050391 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83048aaf-c8cd-4fae-bd20-bcc7e192f242 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:55.060613 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83048aaf-c8cd-4fae-bd20-bcc7e192f242 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:55.066627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33953acc-a30e-4f99-80b9-0de68168851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:55.067272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33953acc-a30e-4f99-80b9-0de68168851e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:55.067558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33953acc-a30e-4f99-80b9-0de68168851e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:55.067854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33953acc-a30e-4f99-80b9-0de68168851e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:55.068507 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33953acc-a30e-4f99-80b9-0de68168851e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:55.076402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33953acc-a30e-4f99-80b9-0de68168851e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:55.089612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1080/2171] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:55.093913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e13c3-7c1f-4b62-be61-0858e967d345 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:55.104865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e13c3-7c1f-4b62-be61-0858e967d345 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:55.109790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185c6bb-f69a-4813-ade4-46604e1ec6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:55.110473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185c6bb-f69a-4813-ade4-46604e1ec6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:55.110750 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185c6bb-f69a-4813-ade4-46604e1ec6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:55.111021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185c6bb-f69a-4813-ade4-46604e1ec6f8 admin admin] PATH_INFO: `/v3/projects/d04a4cdf75f14f68bf2e52b0d9b96618/users/737d38c8799e439ca9571174127138c7/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:55.130230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185c6bb-f69a-4813-ade4-46604e1ec6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04a4cdf75f14f68bf2e52b0d9b96618, user_id=737d38c8799e439ca9571174127138c7, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:55.133613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185c6bb-f69a-4813-ade4-46604e1ec6f8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:55.153441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1092/2172] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:55 2022] PUT /identity/v3/projects/d04a4cdf75f14f68bf2e52b0d9b96618/users/737d38c8799e439ca9571174127138c7/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:55.154106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33953acc-a30e-4f99-80b9-0de68168851e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:55.166867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33953acc-a30e-4f99-80b9-0de68168851e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:55.231914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:55.254828 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f77c6-ec74-409b-8907-3c08ca210927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:55.255597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f77c6-ec74-409b-8907-3c08ca210927 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:55.255961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f77c6-ec74-409b-8907-3c08ca210927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:55.256338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f77c6-ec74-409b-8907-3c08ca210927 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:55.257025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f77c6-ec74-409b-8907-3c08ca210927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:55.258797 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f77c6-ec74-409b-8907-3c08ca210927 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:55.270341 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1081/2173] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:55.274427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185c6bb-f69a-4813-ade4-46604e1ec6f8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:55.287049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185c6bb-f69a-4813-ade4-46604e1ec6f8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:55.303005 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66257-f9f8-48e5-8d1e-38a7c5235284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:55.303816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66257-f9f8-48e5-8d1e-38a7c5235284 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:55.304193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66257-f9f8-48e5-8d1e-38a7c5235284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:55.304625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66257-f9f8-48e5-8d1e-38a7c5235284 admin admin] PATH_INFO: `/v3/projects/d04a4cdf75f14f68bf2e52b0d9b96618/users/737d38c8799e439ca9571174127138c7/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:55.307508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab66257-f9f8-48e5-8d1e-38a7c5235284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04a4cdf75f14f68bf2e52b0d9b96618, user_id=737d38c8799e439ca9571174127138c7, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:55.310955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab66257-f9f8-48e5-8d1e-38a7c5235284 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:55.326615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1093/2174] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:55 2022] PUT /identity/v3/projects/d04a4cdf75f14f68bf2e52b0d9b96618/users/737d38c8799e439ca9571174127138c7/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:55.336573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438faecd-5686-40dd-abd6-5b70e62808df None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:55.336858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438faecd-5686-40dd-abd6-5b70e62808df None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:55.337294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438faecd-5686-40dd-abd6-5b70e62808df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:55.368862 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-438faecd-5686-40dd-abd6-5b70e62808df None None] MFA Rules not processed for user `737d38c8799e439ca9571174127138c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:55.370170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-438faecd-5686-40dd-abd6-5b70e62808df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:55.463306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1082/2175] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:55.471210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66257-f9f8-48e5-8d1e-38a7c5235284 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:55.473916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8ab66257-f9f8-48e5-8d1e-38a7c5235284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:55.538593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66257-f9f8-48e5-8d1e-38a7c5235284 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:55.542828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0cfec-81ec-4bfc-bd3f-fdeb919e2d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:55.543440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0cfec-81ec-4bfc-bd3f-fdeb919e2d84 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:55.543722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0cfec-81ec-4bfc-bd3f-fdeb919e2d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:55.543995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0cfec-81ec-4bfc-bd3f-fdeb919e2d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:55.553694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0cfec-81ec-4bfc-bd3f-fdeb919e2d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:55.555172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0cfec-81ec-4bfc-bd3f-fdeb919e2d84 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:55.564559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1094/2176] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:55.951758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438faecd-5686-40dd-abd6-5b70e62808df None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:56.017276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438faecd-5686-40dd-abd6-5b70e62808df None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:56.021782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:56.022433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:56.022712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:56.022984 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] PATH_INFO: `/v3/users/bc4039297dec481ea1f353acf7cad247` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:56.024091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4039297dec481ea1f353acf7cad247)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:56.025981 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:56.071716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4039297dec481ea1f353acf7cad247'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.072381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4039297dec481ea1f353acf7cad247'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.072986 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4039297dec481ea1f353acf7cad247'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.080092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4039297dec481ea1f353acf7cad247'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.087322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4039297dec481ea1f353acf7cad247'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.101027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:56.108421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1083/2177] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:55 2022] DELETE /identity/v3/users/bc4039297dec481ea1f353acf7cad247 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:56.113665 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb5a9-d4ab-469b-a908-6361353e8c92 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:56.113960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb5a9-d4ab-469b-a908-6361353e8c92 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:56.114277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb5a9-d4ab-469b-a908-6361353e8c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:56.124051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:56.136981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9a7bb5a9-d4ab-469b-a908-6361353e8c92 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:56.138411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9a7bb5a9-d4ab-469b-a908-6361353e8c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:56.199044 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1095/2178] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:56.208730 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:56.210158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:56.271183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f63c9-ed45-47af-b7b0-ba98ada02c29 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:56.275186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc92b0-ea36-40cc-beab-76cca883430a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:56.275923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc92b0-ea36-40cc-beab-76cca883430a service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:56.276289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc92b0-ea36-40cc-beab-76cca883430a service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:56.276564 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc92b0-ea36-40cc-beab-76cca883430a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:56.277858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb5a9-d4ab-469b-a908-6361353e8c92 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:56.279282 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9a7bb5a9-d4ab-469b-a908-6361353e8c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:56.287438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc92b0-ea36-40cc-beab-76cca883430a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:56.289496 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc92b0-ea36-40cc-beab-76cca883430a service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:56.291505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb5a9-d4ab-469b-a908-6361353e8c92 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:56.296311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:56.296932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:56.297212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:56.297486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] PATH_INFO: `/v3/users/b0279525895b4cd186f8714153b56d0b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:56.298657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0279525895b4cd186f8714153b56d0b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:56.299075 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1084/2179] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:56.301354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:56.350966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0279525895b4cd186f8714153b56d0b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.358391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0279525895b4cd186f8714153b56d0b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.371715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0279525895b4cd186f8714153b56d0b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.379518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0279525895b4cd186f8714153b56d0b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.380156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0279525895b4cd186f8714153b56d0b'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.386352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1096/2180] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:56 2022] DELETE /identity/v3/users/b0279525895b4cd186f8714153b56d0b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:56.391012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cad92f-d58a-4267-a63d-91cbd05c0dba None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:56.391323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cad92f-d58a-4267-a63d-91cbd05c0dba None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:56.391597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cad92f-d58a-4267-a63d-91cbd05c0dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:56.412846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-41cad92f-d58a-4267-a63d-91cbd05c0dba None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:56.414566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-41cad92f-d58a-4267-a63d-91cbd05c0dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:56.503056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1085/2181] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:56.504106 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:56.505641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:56.514904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cad92f-d58a-4267-a63d-91cbd05c0dba None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:56.518102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-41cad92f-d58a-4267-a63d-91cbd05c0dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:56.531711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047246d2-3737-4731-8e54-f964c4353612 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:56.540270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e93ffe-de22-4165-b86d-8c7e0d97c8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:56.541660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e93ffe-de22-4165-b86d-8c7e0d97c8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:56.544524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e93ffe-de22-4165-b86d-8c7e0d97c8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:56.544824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e93ffe-de22-4165-b86d-8c7e0d97c8ba admin admin] PATH_INFO: `/v3/users/481dc515d0094724a978e07c261372e0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:56.547780 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e93ffe-de22-4165-b86d-8c7e0d97c8ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=481dc515d0094724a978e07c261372e0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:56.553540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e93ffe-de22-4165-b86d-8c7e0d97c8ba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:56.623121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cad92f-d58a-4267-a63d-91cbd05c0dba None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:56.629363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36536db-6f04-4d14-a2f7-7b85b2e7d633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:56.630454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36536db-6f04-4d14-a2f7-7b85b2e7d633 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:56.630832 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36536db-6f04-4d14-a2f7-7b85b2e7d633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:56.631002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e93ffe-de22-4165-b86d-8c7e0d97c8ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481dc515d0094724a978e07c261372e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.631372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36536db-6f04-4d14-a2f7-7b85b2e7d633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:56.639460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e93ffe-de22-4165-b86d-8c7e0d97c8ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481dc515d0094724a978e07c261372e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.642952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36536db-6f04-4d14-a2f7-7b85b2e7d633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:56.645212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36536db-6f04-4d14-a2f7-7b85b2e7d633 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:56.655956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1086/2182] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:56.656953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36536db-6f04-4d14-a2f7-7b85b2e7d633 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:56.658404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f36536db-6f04-4d14-a2f7-7b85b2e7d633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:56.660154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:56.662769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e93ffe-de22-4165-b86d-8c7e0d97c8ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481dc515d0094724a978e07c261372e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.677342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36536db-6f04-4d14-a2f7-7b85b2e7d633 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:56.678249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e93ffe-de22-4165-b86d-8c7e0d97c8ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481dc515d0094724a978e07c261372e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.679878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20e93ffe-de22-4165-b86d-8c7e0d97c8ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481dc515d0094724a978e07c261372e0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.685335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:56.686141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:56.686495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:56.686839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] PATH_INFO: `/v3/projects/148b2bb6131e4cec8d020fe6ebab447e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:56.687986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1097/2183] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:56 2022] DELETE /identity/v3/users/481dc515d0094724a978e07c261372e0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:56.688112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=148b2bb6131e4cec8d020fe6ebab447e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:56.690243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:56.693860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486c8e-53fd-414c-89bd-586a7d46c625 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:56.694186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486c8e-53fd-414c-89bd-586a7d46c625 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:56.694546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82486c8e-53fd-414c-89bd-586a7d46c625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:56.720871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-82486c8e-53fd-414c-89bd-586a7d46c625 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:56.722723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-82486c8e-53fd-414c-89bd-586a7d46c625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:56.761815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:56.773116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '148b2bb6131e4cec8d020fe6ebab447e', 'request_id': 'req-fd016942-a101-4695-86f9-1e4af4edfc5e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.785552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '148b2bb6131e4cec8d020fe6ebab447e', 'request_id': 'req-fd016942-a101-4695-86f9-1e4af4edfc5e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.795576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '148b2bb6131e4cec8d020fe6ebab447e', 'request_id': 'req-fd016942-a101-4695-86f9-1e4af4edfc5e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.806241 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1098/2184] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:56.814893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] The token cache is being invalidate because project 148b2bb6131e4cec8d020fe6ebab447e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:56.815191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.815989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.816853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82486c8e-53fd-414c-89bd-586a7d46c625 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:56.817889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1087/2185] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:56 2022] DELETE /identity/v3/projects/148b2bb6131e4cec8d020fe6ebab447e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:56.819216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-82486c8e-53fd-414c-89bd-586a7d46c625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:56.821392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:56.822812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:56.899783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82486c8e-53fd-414c-89bd-586a7d46c625 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:56.900263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd016942-a101-4695-86f9-1e4af4edfc5e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:56.905754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9696a4d-e213-4241-864c-db35368a41f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:56.906557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9696a4d-e213-4241-864c-db35368a41f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:56.906892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9696a4d-e213-4241-864c-db35368a41f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:56.907239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9696a4d-e213-4241-864c-db35368a41f8 admin admin] PATH_INFO: `/v3/users/737d38c8799e439ca9571174127138c7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:56.908803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9696a4d-e213-4241-864c-db35368a41f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737d38c8799e439ca9571174127138c7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:56.911316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9696a4d-e213-4241-864c-db35368a41f8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:56.964838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0c25d-cb7f-4e2f-bcd9-0dfa019bbe2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:56.965432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0c25d-cb7f-4e2f-bcd9-0dfa019bbe2d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:56.965714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0c25d-cb7f-4e2f-bcd9-0dfa019bbe2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:56.965991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0c25d-cb7f-4e2f-bcd9-0dfa019bbe2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:56.968555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b2c0c25d-cb7f-4e2f-bcd9-0dfa019bbe2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:56.977549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9696a4d-e213-4241-864c-db35368a41f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737d38c8799e439ca9571174127138c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.978322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9696a4d-e213-4241-864c-db35368a41f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737d38c8799e439ca9571174127138c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.979150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9696a4d-e213-4241-864c-db35368a41f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737d38c8799e439ca9571174127138c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:56.986214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0c25d-cb7f-4e2f-bcd9-0dfa019bbe2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:56.987710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0c25d-cb7f-4e2f-bcd9-0dfa019bbe2d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:56.992231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9696a4d-e213-4241-864c-db35368a41f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737d38c8799e439ca9571174127138c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.003890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b9696a4d-e213-4241-864c-db35368a41f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737d38c8799e439ca9571174127138c7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.012298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1099/2186] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:57.016170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0c25d-cb7f-4e2f-bcd9-0dfa019bbe2d service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:57.019274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b2c0c25d-cb7f-4e2f-bcd9-0dfa019bbe2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:57.036298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1088/2187] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:56 2022] DELETE /identity/v3/users/737d38c8799e439ca9571174127138c7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:57.039158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0c25d-cb7f-4e2f-bcd9-0dfa019bbe2d service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:57.132974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:57.156211 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:57.156940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.157228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.157503 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] PATH_INFO: `/v3/projects/96434dc27eda41b5969432a8328a1cb2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.159745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96434dc27eda41b5969432a8328a1cb2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:57.161196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:57.220743 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96434dc27eda41b5969432a8328a1cb2', 'request_id': 'req-3e478fba-5142-4038-82b0-4ff51f0534a7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.227626 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96434dc27eda41b5969432a8328a1cb2', 'request_id': 'req-3e478fba-5142-4038-82b0-4ff51f0534a7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.242166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96434dc27eda41b5969432a8328a1cb2', 'request_id': 'req-3e478fba-5142-4038-82b0-4ff51f0534a7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.256034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] The token cache is being invalidate because project 96434dc27eda41b5969432a8328a1cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:57.256281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.257127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-3e478fba-5142-4038-82b0-4ff51f0534a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.258688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1100/2188] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:57 2022] DELETE /identity/v3/projects/96434dc27eda41b5969432a8328a1cb2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:57.263595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb84e8-f753-4edd-b811-1c5bcffb9cbe None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.264027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb84e8-f753-4edd-b811-1c5bcffb9cbe None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.264349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb84e8-f753-4edd-b811-1c5bcffb9cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.283911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-07eb84e8-f753-4edd-b811-1c5bcffb9cbe None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:57.285466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-07eb84e8-f753-4edd-b811-1c5bcffb9cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:57.330376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:57.351973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1089/2189] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:57.359832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef57ae-da3e-4fa0-8cd5-907e32e26f9e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.360420 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef57ae-da3e-4fa0-8cd5-907e32e26f9e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.360420 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef57ae-da3e-4fa0-8cd5-907e32e26f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.380019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8cef57ae-da3e-4fa0-8cd5-907e32e26f9e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:57.381242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8cef57ae-da3e-4fa0-8cd5-907e32e26f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:57.389114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1101/2190] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:57.393488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb84e8-f753-4edd-b811-1c5bcffb9cbe None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:57.404142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb84e8-f753-4edd-b811-1c5bcffb9cbe None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:57.410441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c954-13c0-4e04-be20-0d3d83e2ddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:57.411325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c954-13c0-4e04-be20-0d3d83e2ddd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.411441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c954-13c0-4e04-be20-0d3d83e2ddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.411751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1c954-13c0-4e04-be20-0d3d83e2ddd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.412417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1c954-13c0-4e04-be20-0d3d83e2ddd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:57.412800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1c954-13c0-4e04-be20-0d3d83e2ddd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:57.414676 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1c954-13c0-4e04-be20-0d3d83e2ddd0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:57.430240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1090/2191] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:57.434929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef57ae-da3e-4fa0-8cd5-907e32e26f9e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:57.443965 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c954-13c0-4e04-be20-0d3d83e2ddd0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:57.445973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7cf1c954-13c0-4e04-be20-0d3d83e2ddd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:57.446744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef57ae-da3e-4fa0-8cd5-907e32e26f9e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:57.457520 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a196ede-3385-4aad-bd41-e3533609a78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:57.458178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a196ede-3385-4aad-bd41-e3533609a78e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.458458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a196ede-3385-4aad-bd41-e3533609a78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.458719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a196ede-3385-4aad-bd41-e3533609a78e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.459765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a196ede-3385-4aad-bd41-e3533609a78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:57.463199 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a196ede-3385-4aad-bd41-e3533609a78e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:57.478055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1c954-13c0-4e04-be20-0d3d83e2ddd0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:57.485439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:57.486580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.487001 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.487383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] PATH_INFO: `/v3/projects/7d815820d34347989c945b717534b9d1` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.488916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d815820d34347989c945b717534b9d1)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:57.491246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:57.500536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1102/2192] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:57 2022] POST /identity/v3/projects => generated 399 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:57.501271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a196ede-3385-4aad-bd41-e3533609a78e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:57.504751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8a196ede-3385-4aad-bd41-e3533609a78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:57.552856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d815820d34347989c945b717534b9d1', 'request_id': 'req-229b95c2-b3fd-408a-9879-be54001c7c0b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.559288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d815820d34347989c945b717534b9d1', 'request_id': 'req-229b95c2-b3fd-408a-9879-be54001c7c0b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.567680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d815820d34347989c945b717534b9d1', 'request_id': 'req-229b95c2-b3fd-408a-9879-be54001c7c0b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.574859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a196ede-3385-4aad-bd41-e3533609a78e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:57.579525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] The token cache is being invalidate because project 7d815820d34347989c945b717534b9d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:57.579812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.580479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.582618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1091/2193] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:57 2022] DELETE /identity/v3/projects/7d815820d34347989c945b717534b9d1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:57.585842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:57.585842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:57.634125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:57.643077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:57.644646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.645249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.645642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] PATH_INFO: `/v3/projects/d04a4cdf75f14f68bf2e52b0d9b96618` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.647194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04a4cdf75f14f68bf2e52b0d9b96618)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:57.649271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:57.656468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b95c2-b3fd-408a-9879-be54001c7c0b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:57.661285 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5f560-65d1-45a5-8ae9-3a426820aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:57.661884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f560-65d1-45a5-8ae9-3a426820aa5a admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.662224 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f560-65d1-45a5-8ae9-3a426820aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.662496 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5f560-65d1-45a5-8ae9-3a426820aa5a admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.663112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5f560-65d1-45a5-8ae9-3a426820aa5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:57.665010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5f560-65d1-45a5-8ae9-3a426820aa5a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:57.685232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1092/2194] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:57 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:57.686306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5f560-65d1-45a5-8ae9-3a426820aa5a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:57.688078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-78d5f560-65d1-45a5-8ae9-3a426820aa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:57.698889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04a4cdf75f14f68bf2e52b0d9b96618', 'request_id': 'req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.701428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5f560-65d1-45a5-8ae9-3a426820aa5a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:57.705263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04a4cdf75f14f68bf2e52b0d9b96618', 'request_id': 'req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.712301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04a4cdf75f14f68bf2e52b0d9b96618', 'request_id': 'req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.723697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] The token cache is being invalidate because project d04a4cdf75f14f68bf2e52b0d9b96618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:57.723988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.724639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.726156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1103/2195] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:57 2022] DELETE /identity/v3/projects/d04a4cdf75f14f68bf2e52b0d9b96618 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:57.726920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:57.728275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:57.749101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:57.768203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e6bc8-aa91-4a20-bf13-74d879d2cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:57.769473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e6bc8-aa91-4a20-bf13-74d879d2cf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.769795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e6bc8-aa91-4a20-bf13-74d879d2cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.770043 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e6bc8-aa91-4a20-bf13-74d879d2cf9f admin admin] PATH_INFO: `/v3/users/394db0e113494d5f93eedf799f721a97` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.771189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e6bc8-aa91-4a20-bf13-74d879d2cf9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=394db0e113494d5f93eedf799f721a97)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:57.773118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e6bc8-aa91-4a20-bf13-74d879d2cf9f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:57.794693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bbc73-f977-4ed1-8a27-4f19a90e4058 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:57.803516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bc0d4-ed90-4767-a09c-b30cc44401f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:57.804267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bc0d4-ed90-4767-a09c-b30cc44401f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.804889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bc0d4-ed90-4767-a09c-b30cc44401f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.805209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bc0d4-ed90-4767-a09c-b30cc44401f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.805985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bc0d4-ed90-4767-a09c-b30cc44401f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:57.808835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bc0d4-ed90-4767-a09c-b30cc44401f1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:57.824050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1104/2196] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:57.824050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020f241-51cd-4c31-abe2-7f97ef695d9e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.824050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020f241-51cd-4c31-abe2-7f97ef695d9e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.824050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020f241-51cd-4c31-abe2-7f97ef695d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.836792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6e1e6bc8-aa91-4a20-bf13-74d879d2cf9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394db0e113494d5f93eedf799f721a97'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.837722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6e1e6bc8-aa91-4a20-bf13-74d879d2cf9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394db0e113494d5f93eedf799f721a97'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.839016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6e1e6bc8-aa91-4a20-bf13-74d879d2cf9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394db0e113494d5f93eedf799f721a97'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.845626 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e020f241-51cd-4c31-abe2-7f97ef695d9e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:57.847176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e020f241-51cd-4c31-abe2-7f97ef695d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:57.847741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6e1e6bc8-aa91-4a20-bf13-74d879d2cf9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394db0e113494d5f93eedf799f721a97'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.857627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6e1e6bc8-aa91-4a20-bf13-74d879d2cf9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394db0e113494d5f93eedf799f721a97'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:57.860623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1105/2197] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:57.870172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020f241-51cd-4c31-abe2-7f97ef695d9e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:57.870172 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e020f241-51cd-4c31-abe2-7f97ef695d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:57.876960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020f241-51cd-4c31-abe2-7f97ef695d9e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:57.883737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be8384-d59a-4187-bdc1-2ad6fef7959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:57.884360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be8384-d59a-4187-bdc1-2ad6fef7959b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.884643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be8384-d59a-4187-bdc1-2ad6fef7959b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.884917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be8384-d59a-4187-bdc1-2ad6fef7959b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.885565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be8384-d59a-4187-bdc1-2ad6fef7959b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:57.887216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be8384-d59a-4187-bdc1-2ad6fef7959b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:57.888803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1093/2198] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:57 2022] DELETE /identity/v3/users/394db0e113494d5f93eedf799f721a97 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:57.890365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb5dff-59fd-461d-aa98-4b88762caf2a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.890840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb5dff-59fd-461d-aa98-4b88762caf2a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.891251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb5dff-59fd-461d-aa98-4b88762caf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:57.901811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1106/2199] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:57.903309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be8384-d59a-4187-bdc1-2ad6fef7959b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:57.913769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be8384-d59a-4187-bdc1-2ad6fef7959b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:57.917545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d3fb5dff-59fd-461d-aa98-4b88762caf2a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:57.919038 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d3fb5dff-59fd-461d-aa98-4b88762caf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:57.993516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923268d7-f494-4953-86ce-5bd3bb565582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:57.994235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923268d7-f494-4953-86ce-5bd3bb565582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:57.994830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923268d7-f494-4953-86ce-5bd3bb565582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:57.994830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923268d7-f494-4953-86ce-5bd3bb565582 admin admin] PATH_INFO: `/v3/projects/b226f856c3f049c38c7ece18953018e1/users/aeee54dd5c584962a743ea7e91cfa221/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.006788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:58.011199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1094/2200] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:58.012634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923268d7-f494-4953-86ce-5bd3bb565582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b226f856c3f049c38c7ece18953018e1, user_id=aeee54dd5c584962a743ea7e91cfa221, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:58.015929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb5dff-59fd-461d-aa98-4b88762caf2a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:58.021066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923268d7-f494-4953-86ce-5bd3bb565582 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:58.026798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb5dff-59fd-461d-aa98-4b88762caf2a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:58.032502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c8ed8-6c19-4a94-9303-b692c82e24dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:58.033140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c8ed8-6c19-4a94-9303-b692c82e24dc admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:58.033460 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c8ed8-6c19-4a94-9303-b692c82e24dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:58.033920 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c8ed8-6c19-4a94-9303-b692c82e24dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.035421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c8ed8-6c19-4a94-9303-b692c82e24dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:58.035759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c8ed8-6c19-4a94-9303-b692c82e24dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:58.037364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c8ed8-6c19-4a94-9303-b692c82e24dc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:58.046094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1107/2201] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:57 2022] PUT /identity/v3/projects/b226f856c3f049c38c7ece18953018e1/users/aeee54dd5c584962a743ea7e91cfa221/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:58.052618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52d0ba-0de9-40e1-932d-93d48dbd4130 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:58.053002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52d0ba-0de9-40e1-932d-93d48dbd4130 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:58.053372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52d0ba-0de9-40e1-932d-93d48dbd4130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.057376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1095/2202] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:58.071438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c8ed8-6c19-4a94-9303-b692c82e24dc admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:58.083577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c8ed8-6c19-4a94-9303-b692c82e24dc admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:58.084431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8b52d0ba-0de9-40e1-932d-93d48dbd4130 None None] MFA Rules not processed for user `aeee54dd5c584962a743ea7e91cfa221`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:58.086152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8b52d0ba-0de9-40e1-932d-93d48dbd4130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:58.154526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:58.162548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e6f0b-255c-4372-911d-a26424afa0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:58.163510 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6f0b-255c-4372-911d-a26424afa0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:58.163902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6f0b-255c-4372-911d-a26424afa0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:58.164224 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e6f0b-255c-4372-911d-a26424afa0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.165309 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e6f0b-255c-4372-911d-a26424afa0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:58.168228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e6f0b-255c-4372-911d-a26424afa0f6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:58.171400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1108/2203] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:58.184529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52d0ba-0de9-40e1-932d-93d48dbd4130 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:58.186157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8b52d0ba-0de9-40e1-932d-93d48dbd4130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:58.228943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1096/2204] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:58 2022] POST /identity/v3/projects => generated 359 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:58.230233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e6f0b-255c-4372-911d-a26424afa0f6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:58.235674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6a6e6f0b-255c-4372-911d-a26424afa0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:58.268709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52d0ba-0de9-40e1-932d-93d48dbd4130 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:58.324465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e6f0b-255c-4372-911d-a26424afa0f6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:58.329858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:58.331391 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:58.331685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:58.331957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] PATH_INFO: `/v3/projects/ca04091dbc784625a41f13e58e96db4c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.333570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca04091dbc784625a41f13e58e96db4c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:58.335970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:58.340642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855ffe6-f615-4411-a874-513535e85684 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:58.341451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855ffe6-f615-4411-a874-513535e85684 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:58.341736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855ffe6-f615-4411-a874-513535e85684 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:58.342109 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855ffe6-f615-4411-a874-513535e85684 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.408569 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:58.417458 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca04091dbc784625a41f13e58e96db4c', 'request_id': 'req-906ed309-0c1c-495f-8449-a19e00804334'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:58.422153 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855ffe6-f615-4411-a874-513535e85684 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:58.424102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855ffe6-f615-4411-a874-513535e85684 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:58.428706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca04091dbc784625a41f13e58e96db4c', 'request_id': 'req-906ed309-0c1c-495f-8449-a19e00804334'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:58.436287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1109/2205] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:23:58.437326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855ffe6-f615-4411-a874-513535e85684 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:58.437506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca04091dbc784625a41f13e58e96db4c', 'request_id': 'req-906ed309-0c1c-495f-8449-a19e00804334'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:58.448608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855ffe6-f615-4411-a874-513535e85684 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:58.455179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] The token cache is being invalidate because project ca04091dbc784625a41f13e58e96db4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:58.455480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:58.456188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:58.457962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1097/2206] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:58 2022] DELETE /identity/v3/projects/ca04091dbc784625a41f13e58e96db4c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:58.462192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:58.463931 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:58.542540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d1d4-04b2-487f-91bc-fae48b330aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:58.543281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d1d4-04b2-487f-91bc-fae48b330aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:58.543571 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d1d4-04b2-487f-91bc-fae48b330aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:58.544171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7d1d4-04b2-487f-91bc-fae48b330aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.544868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7d1d4-04b2-487f-91bc-fae48b330aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:58.548539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7d1d4-04b2-487f-91bc-fae48b330aa2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:58.580811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1110/2207] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:58 2022] POST /identity/v3/users => generated 280 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:23:58.582837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d1d4-04b2-487f-91bc-fae48b330aa2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:58.586823 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c0e7d1d4-04b2-487f-91bc-fae48b330aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:58.590812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ed309-0c1c-495f-8449-a19e00804334 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:58.598764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:58.599411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:58.599739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:58.600015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] PATH_INFO: `/v3/users/e4f9f4bac747418d9d40ffd71d07fb28` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.601209 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f9f4bac747418d9d40ffd71d07fb28)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:58.603236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:58.603595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7d1d4-04b2-487f-91bc-fae48b330aa2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:58.611915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b76479-68c3-437b-892c-b2734c8c3d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:58.614099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b76479-68c3-437b-892c-b2734c8c3d29 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:58.614099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b76479-68c3-437b-892c-b2734c8c3d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:58.614099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b76479-68c3-437b-892c-b2734c8c3d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.614516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b76479-68c3-437b-892c-b2734c8c3d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:58.616448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b76479-68c3-437b-892c-b2734c8c3d29 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:58.624305 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:58.628749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1111/2208] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:58.633018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b76479-68c3-437b-892c-b2734c8c3d29 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:58.645960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b76479-68c3-437b-892c-b2734c8c3d29 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:58.653554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b982-ea63-443d-8628-66cab74b9254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:58.654344 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b982-ea63-443d-8628-66cab74b9254 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:58.654874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b982-ea63-443d-8628-66cab74b9254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:58.655266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179b982-ea63-443d-8628-66cab74b9254 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.656269 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179b982-ea63-443d-8628-66cab74b9254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:58.658249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179b982-ea63-443d-8628-66cab74b9254 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:58.676153 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1112/2209] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:58.680543 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b982-ea63-443d-8628-66cab74b9254 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:58.696079 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f9f4bac747418d9d40ffd71d07fb28'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:58.698119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f9f4bac747418d9d40ffd71d07fb28'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:58.699113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f9f4bac747418d9d40ffd71d07fb28'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:58.699278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179b982-ea63-443d-8628-66cab74b9254 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:58.704556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845b373-6ff1-4b47-a95e-2d1b273e7777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:58.705244 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b373-6ff1-4b47-a95e-2d1b273e7777 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:58.705518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b373-6ff1-4b47-a95e-2d1b273e7777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:58.706152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b373-6ff1-4b47-a95e-2d1b273e7777 admin admin] PATH_INFO: `/v3/projects/e7fb8837dfb741a19f373d6bbb54e75b/users/51ca424f33874d08bc44f8370f8dc233/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.724699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f9f4bac747418d9d40ffd71d07fb28'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:58.724798 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845b373-6ff1-4b47-a95e-2d1b273e7777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fb8837dfb741a19f373d6bbb54e75b, user_id=51ca424f33874d08bc44f8370f8dc233, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:58.727925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845b373-6ff1-4b47-a95e-2d1b273e7777 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:58.730325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f9f4bac747418d9d40ffd71d07fb28'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:58.748224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1113/2210] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:58 2022] PUT /identity/v3/projects/e7fb8837dfb741a19f373d6bbb54e75b/users/51ca424f33874d08bc44f8370f8dc233/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:23:58.759530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213996f-4622-438c-b387-507732f3ef99 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:58.759822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213996f-4622-438c-b387-507732f3ef99 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:58.760101 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213996f-4622-438c-b387-507732f3ef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:58.772823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1098/2211] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:58 2022] DELETE /identity/v3/users/e4f9f4bac747418d9d40ffd71d07fb28 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:58.818803 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-1213996f-4622-438c-b387-507732f3ef99 None None] MFA Rules not processed for user `51ca424f33874d08bc44f8370f8dc233`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:58.820790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1213996f-4622-438c-b387-507732f3ef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:58.917167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1114/2212] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:58.951186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:58.952886 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:59.060037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d986513-3ec7-4495-a907-2dab7debce3d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.063826 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca22832-a4e8-48d4-8711-6f2bf2e249a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.064441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca22832-a4e8-48d4-8711-6f2bf2e249a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.064721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca22832-a4e8-48d4-8711-6f2bf2e249a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.064994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca22832-a4e8-48d4-8711-6f2bf2e249a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.074796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca22832-a4e8-48d4-8711-6f2bf2e249a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.076302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca22832-a4e8-48d4-8711-6f2bf2e249a9 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.090401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1099/2213] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:59.106860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213996f-4622-438c-b387-507732f3ef99 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:59.108501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-1213996f-4622-438c-b387-507732f3ef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:59.136113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:59.188388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213996f-4622-438c-b387-507732f3ef99 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.194282 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5f2a0-b0e2-43c7-a95e-61e84cfca2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.194919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f2a0-b0e2-43c7-a95e-61e84cfca2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.195200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f2a0-b0e2-43c7-a95e-61e84cfca2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.195460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f2a0-b0e2-43c7-a95e-61e84cfca2dc admin admin] PATH_INFO: `/v3/users/51ca424f33874d08bc44f8370f8dc233` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.198966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5f2a0-b0e2-43c7-a95e-61e84cfca2dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ca424f33874d08bc44f8370f8dc233)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.198966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5f2a0-b0e2-43c7-a95e-61e84cfca2dc admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.200126 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca22832-a4e8-48d4-8711-6f2bf2e249a9 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:59.201711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2ca22832-a4e8-48d4-8711-6f2bf2e249a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:59.223636 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca22832-a4e8-48d4-8711-6f2bf2e249a9 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.230846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.231503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.231811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.232122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] PATH_INFO: `/v3/projects/235ada38c83441e9b5f932b718370a91` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.233334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=235ada38c83441e9b5f932b718370a91)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.235335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.266483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-31d5f2a0-b0e2-43c7-a95e-61e84cfca2dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ca424f33874d08bc44f8370f8dc233'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.274657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-31d5f2a0-b0e2-43c7-a95e-61e84cfca2dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ca424f33874d08bc44f8370f8dc233'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.286765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-31d5f2a0-b0e2-43c7-a95e-61e84cfca2dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ca424f33874d08bc44f8370f8dc233'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.291958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235ada38c83441e9b5f932b718370a91', 'request_id': 'req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.295243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-31d5f2a0-b0e2-43c7-a95e-61e84cfca2dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ca424f33874d08bc44f8370f8dc233'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.295850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-31d5f2a0-b0e2-43c7-a95e-61e84cfca2dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ca424f33874d08bc44f8370f8dc233'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.297667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235ada38c83441e9b5f932b718370a91', 'request_id': 'req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.303175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1115/2214] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:59 2022] DELETE /identity/v3/users/51ca424f33874d08bc44f8370f8dc233 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:59.307492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20afe-9509-49e9-a73b-bf22e16ae2cc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.307810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20afe-9509-49e9-a73b-bf22e16ae2cc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.308093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e20afe-9509-49e9-a73b-bf22e16ae2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.309605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235ada38c83441e9b5f932b718370a91', 'request_id': 'req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.321873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] The token cache is being invalidate because project 235ada38c83441e9b5f932b718370a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:23:59.322336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.323023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3ef40a89-9cbc-4c67-8933-f6182a3f1e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.324538 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1100/2215] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:59 2022] DELETE /identity/v3/projects/235ada38c83441e9b5f932b718370a91 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:59.329182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d14bf-eba3-4976-9b17-f381aefd3630 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.329550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d14bf-eba3-4976-9b17-f381aefd3630 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.329885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d14bf-eba3-4976-9b17-f381aefd3630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.330780 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e6e20afe-9509-49e9-a73b-bf22e16ae2cc None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:59.332592 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e6e20afe-9509-49e9-a73b-bf22e16ae2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:59.350183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-500d14bf-eba3-4976-9b17-f381aefd3630 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:59.351409 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-500d14bf-eba3-4976-9b17-f381aefd3630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:59.360012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:59.398168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1116/2216] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:59.403177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e20afe-9509-49e9-a73b-bf22e16ae2cc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:59.404638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e6e20afe-9509-49e9-a73b-bf22e16ae2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:59.416604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e20afe-9509-49e9-a73b-bf22e16ae2cc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.419605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1101/2217] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:23:59.422245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d14bf-eba3-4976-9b17-f381aefd3630 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:59.422330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ec21a-fdf1-4e1a-bef2-0ce8b8d02e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.422330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ec21a-fdf1-4e1a-bef2-0ce8b8d02e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.422501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ec21a-fdf1-4e1a-bef2-0ce8b8d02e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.422720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ec21a-fdf1-4e1a-bef2-0ce8b8d02e74 admin admin] PATH_INFO: `/v3/users/74f8f4db5d1c411393351121d1a0671f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.423498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-500d14bf-eba3-4976-9b17-f381aefd3630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:59.423924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ec21a-fdf1-4e1a-bef2-0ce8b8d02e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f8f4db5d1c411393351121d1a0671f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.425978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ec21a-fdf1-4e1a-bef2-0ce8b8d02e74 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.466956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:59.478237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e8ec21a-fdf1-4e1a-bef2-0ce8b8d02e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f8f4db5d1c411393351121d1a0671f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.482502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d14bf-eba3-4976-9b17-f381aefd3630 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.485381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e8ec21a-fdf1-4e1a-bef2-0ce8b8d02e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f8f4db5d1c411393351121d1a0671f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.486199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b23d6-b1aa-4a79-b580-bc9d00bb1ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.486987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b23d6-b1aa-4a79-b580-bc9d00bb1ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.487098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b23d6-b1aa-4a79-b580-bc9d00bb1ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.487846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b23d6-b1aa-4a79-b580-bc9d00bb1ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.498776 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b23d6-b1aa-4a79-b580-bc9d00bb1ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.499501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e8ec21a-fdf1-4e1a-bef2-0ce8b8d02e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f8f4db5d1c411393351121d1a0671f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.500233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b23d6-b1aa-4a79-b580-bc9d00bb1ff0 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.508218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e8ec21a-fdf1-4e1a-bef2-0ce8b8d02e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f8f4db5d1c411393351121d1a0671f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.508946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7e8ec21a-fdf1-4e1a-bef2-0ce8b8d02e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f8f4db5d1c411393351121d1a0671f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:23:59.511357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1102/2218] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:59.512384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459eaa3-34c5-46de-ad0a-2c6a347d076c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.512738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459eaa3-34c5-46de-ad0a-2c6a347d076c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.513016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459eaa3-34c5-46de-ad0a-2c6a347d076c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.518302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1117/2219] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:23:59 2022] DELETE /identity/v3/users/74f8f4db5d1c411393351121d1a0671f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:23:59.520040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14bffd-9a6a-428b-b8d2-c5e67c945d22 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.520358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14bffd-9a6a-428b-b8d2-c5e67c945d22 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.520615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14bffd-9a6a-428b-b8d2-c5e67c945d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.534294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5459eaa3-34c5-46de-ad0a-2c6a347d076c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:59.535500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5459eaa3-34c5-46de-ad0a-2c6a347d076c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:59.540208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5d14bffd-9a6a-428b-b8d2-c5e67c945d22 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:23:59.541401 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5d14bffd-9a6a-428b-b8d2-c5e67c945d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:59.611395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1118/2220] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:59.626989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1103/2221] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:23:59.628939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14bffd-9a6a-428b-b8d2-c5e67c945d22 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:59.630431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5d14bffd-9a6a-428b-b8d2-c5e67c945d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:59.631583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459eaa3-34c5-46de-ad0a-2c6a347d076c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:59.643173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459eaa3-34c5-46de-ad0a-2c6a347d076c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.648314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a8e47-a81d-4ce2-a4c7-02a64a8450b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.648988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a8e47-a81d-4ce2-a4c7-02a64a8450b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.649338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a8e47-a81d-4ce2-a4c7-02a64a8450b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.649678 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a8e47-a81d-4ce2-a4c7-02a64a8450b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.650428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a8e47-a81d-4ce2-a4c7-02a64a8450b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:23:59.650793 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a8e47-a81d-4ce2-a4c7-02a64a8450b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.652480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a8e47-a81d-4ce2-a4c7-02a64a8450b6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.665464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1104/2222] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:23:59.669622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a8e47-a81d-4ce2-a4c7-02a64a8450b6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:59.690344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a8e47-a81d-4ce2-a4c7-02a64a8450b6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.695851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29c3a5-4a83-4e66-924b-19904c0ecfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.696462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29c3a5-4a83-4e66-924b-19904c0ecfef admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.696747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29c3a5-4a83-4e66-924b-19904c0ecfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.697088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29c3a5-4a83-4e66-924b-19904c0ecfef admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.697768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29c3a5-4a83-4e66-924b-19904c0ecfef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.699955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29c3a5-4a83-4e66-924b-19904c0ecfef admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.702908 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14bffd-9a6a-428b-b8d2-c5e67c945d22 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.707930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e30aa-05cb-43af-b888-caba2119b24e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.708573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e30aa-05cb-43af-b888-caba2119b24e service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.708834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e30aa-05cb-43af-b888-caba2119b24e service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.709116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e30aa-05cb-43af-b888-caba2119b24e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.721119 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e30aa-05cb-43af-b888-caba2119b24e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.722603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e30aa-05cb-43af-b888-caba2119b24e service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.736385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1105/2223] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:23:59 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:59.736600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1119/2224] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:23:59.738450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29c3a5-4a83-4e66-924b-19904c0ecfef admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:59.781041 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:23:59.837201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29c3a5-4a83-4e66-924b-19904c0ecfef admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.846352 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c26247-fa72-42ac-bdc2-abbf1d1f694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.847399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26247-fa72-42ac-bdc2-abbf1d1f694f admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.847854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26247-fa72-42ac-bdc2-abbf1d1f694f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.849443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26247-fa72-42ac-bdc2-abbf1d1f694f admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.850446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c26247-fa72-42ac-bdc2-abbf1d1f694f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.852582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c26247-fa72-42ac-bdc2-abbf1d1f694f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.875818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e30aa-05cb-43af-b888-caba2119b24e service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:59.879323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e43e30aa-05cb-43af-b888-caba2119b24e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:23:59.888134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1106/2225] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:23:59 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:23:59.892788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c26247-fa72-42ac-bdc2-abbf1d1f694f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:59.911591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e30aa-05cb-43af-b888-caba2119b24e service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.917572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.918139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c26247-fa72-42ac-bdc2-abbf1d1f694f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.918269 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.918540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.918815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] PATH_INFO: `/v3/projects/e7fb8837dfb741a19f373d6bbb54e75b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.920176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fb8837dfb741a19f373d6bbb54e75b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.922213 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.926107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336a005-1d56-48e4-bf13-ef411c4a8528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.927497 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336a005-1d56-48e4-bf13-ef411c4a8528 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.928002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336a005-1d56-48e4-bf13-ef411c4a8528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.928365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336a005-1d56-48e4-bf13-ef411c4a8528 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.929111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336a005-1d56-48e4-bf13-ef411c4a8528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.932952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336a005-1d56-48e4-bf13-ef411c4a8528 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.948944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1107/2226] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:23:59.953678 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336a005-1d56-48e4-bf13-ef411c4a8528 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:23:59.965266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336a005-1d56-48e4-bf13-ef411c4a8528 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:23:59.973373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e501c0-ec69-4d01-b2cb-8e75216d155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:23:59.974160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e501c0-ec69-4d01-b2cb-8e75216d155c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:23:59.974751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e501c0-ec69-4d01-b2cb-8e75216d155c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:23:59.975100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e501c0-ec69-4d01-b2cb-8e75216d155c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:23:59.976227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e501c0-ec69-4d01-b2cb-8e75216d155c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:23:59.979756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e501c0-ec69-4d01-b2cb-8e75216d155c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:23:59.992971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1108/2227] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:23:59.997615 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e501c0-ec69-4d01-b2cb-8e75216d155c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.002568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fb8837dfb741a19f373d6bbb54e75b', 'request_id': 'req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:00.009419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:00.012334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e501c0-ec69-4d01-b2cb-8e75216d155c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:00.015920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fb8837dfb741a19f373d6bbb54e75b', 'request_id': 'req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:00.030352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fb8837dfb741a19f373d6bbb54e75b', 'request_id': 'req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:00.048826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] The token cache is being invalidate because project e7fb8837dfb741a19f373d6bbb54e75b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:24:00.049117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:00.052300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-7a03aaa7-0fd4-42ac-8d50-17a86ffccbd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:00.053855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1120/2228] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:23:59 2022] DELETE /identity/v3/projects/e7fb8837dfb741a19f373d6bbb54e75b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:24:00.058539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaf546-81f1-40fa-a08a-8666c8b2f818 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.058943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaf546-81f1-40fa-a08a-8666c8b2f818 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.059301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaf546-81f1-40fa-a08a-8666c8b2f818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.081826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c8eaf546-81f1-40fa-a08a-8666c8b2f818 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:00.082570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c8eaf546-81f1-40fa-a08a-8666c8b2f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:00.091913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa975f-f392-4ed2-978a-61f37efed9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:00.092579 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa975f-f392-4ed2-978a-61f37efed9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.092855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa975f-f392-4ed2-978a-61f37efed9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.093124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa975f-f392-4ed2-978a-61f37efed9ae admin admin] PATH_INFO: `/v3/projects/fedce057119142068b9f92e07454b9fa/users/d86b39b1bf7546dea03dbf180ab567e2/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.113050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa975f-f392-4ed2-978a-61f37efed9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedce057119142068b9f92e07454b9fa, user_id=d86b39b1bf7546dea03dbf180ab567e2, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:00.115821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa975f-f392-4ed2-978a-61f37efed9ae admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:00.139745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1109/2229] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:23:59 2022] PUT /identity/v3/projects/fedce057119142068b9f92e07454b9fa/users/d86b39b1bf7546dea03dbf180ab567e2/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:24:00.139745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa975f-f392-4ed2-978a-61f37efed9ae admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.141370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-63fa975f-f392-4ed2-978a-61f37efed9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:00.198774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1121/2230] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:24:00.201054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c0378-d7e3-4dab-8d4f-69f0b019cfb7 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.201510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c0378-d7e3-4dab-8d4f-69f0b019cfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.201798 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c0378-d7e3-4dab-8d4f-69f0b019cfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.221482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-970c0378-d7e3-4dab-8d4f-69f0b019cfb7 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:00.224246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-970c0378-d7e3-4dab-8d4f-69f0b019cfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:00.234151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1122/2231] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:00.236200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa975f-f392-4ed2-978a-61f37efed9ae admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:00.240433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74be92-2597-46af-9755-16899cf50c6a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.240703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74be92-2597-46af-9755-16899cf50c6a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.241137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74be92-2597-46af-9755-16899cf50c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.242512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:00.243147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.243474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.244128 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] PATH_INFO: `/v3/projects/41a3f7b4160f4cc5a9a4947769cd2816` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.245349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a3f7b4160f4cc5a9a4947769cd2816)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:00.247773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:00.267573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-de74be92-2597-46af-9755-16899cf50c6a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:00.269446 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-de74be92-2597-46af-9755-16899cf50c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:00.279335 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1123/2232] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:00.280391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74be92-2597-46af-9755-16899cf50c6a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.281578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-de74be92-2597-46af-9755-16899cf50c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:00.290502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:00.354166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a3f7b4160f4cc5a9a4947769cd2816', 'request_id': 'req-87d7370b-02fb-4e45-91ab-cca93275775f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:00.361288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a3f7b4160f4cc5a9a4947769cd2816', 'request_id': 'req-87d7370b-02fb-4e45-91ab-cca93275775f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:00.374462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a3f7b4160f4cc5a9a4947769cd2816', 'request_id': 'req-87d7370b-02fb-4e45-91ab-cca93275775f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:00.400777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74be92-2597-46af-9755-16899cf50c6a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:00.406948 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] The token cache is being invalidate because project 41a3f7b4160f4cc5a9a4947769cd2816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:24:00.407745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:00.408945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:00.412141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1110/2233] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:24:00 2022] DELETE /identity/v3/projects/41a3f7b4160f4cc5a9a4947769cd2816 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:24:00.413273 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.415235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:00.484346 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf9065-78d3-4ad2-8097-d1ee18fd3868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:00.485073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9065-78d3-4ad2-8097-d1ee18fd3868 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.485493 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9065-78d3-4ad2-8097-d1ee18fd3868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.485796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf9065-78d3-4ad2-8097-d1ee18fd3868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.487972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d6cf9065-78d3-4ad2-8097-d1ee18fd3868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:00.528261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7370b-02fb-4e45-91ab-cca93275775f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:00.537212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405637ad-6fe9-4a25-b4ac-de5e802aefc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:00.537834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405637ad-6fe9-4a25-b4ac-de5e802aefc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.538315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405637ad-6fe9-4a25-b4ac-de5e802aefc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.538681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405637ad-6fe9-4a25-b4ac-de5e802aefc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.539491 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405637ad-6fe9-4a25-b4ac-de5e802aefc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:24:00.539803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405637ad-6fe9-4a25-b4ac-de5e802aefc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:00.542314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405637ad-6fe9-4a25-b4ac-de5e802aefc6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:00.555015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:00.573173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1111/2234] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:24:00.599964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f8061-cdee-43ed-bb6b-b5624edfcfd0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.600421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f8061-cdee-43ed-bb6b-b5624edfcfd0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.600849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f8061-cdee-43ed-bb6b-b5624edfcfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.605199 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf9065-78d3-4ad2-8097-d1ee18fd3868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:00.607205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf9065-78d3-4ad2-8097-d1ee18fd3868 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:00.618302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1124/2235] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:24:00.619288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf9065-78d3-4ad2-8097-d1ee18fd3868 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.633209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf9065-78d3-4ad2-8097-d1ee18fd3868 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:00.639783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79352d-6539-438d-876c-0dd6886f2426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:00.640584 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-871f8061-cdee-43ed-bb6b-b5624edfcfd0 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:00.640765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79352d-6539-438d-876c-0dd6886f2426 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.641137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79352d-6539-438d-876c-0dd6886f2426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.641507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79352d-6539-438d-876c-0dd6886f2426 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.641829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-871f8061-cdee-43ed-bb6b-b5624edfcfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:00.642596 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79352d-6539-438d-876c-0dd6886f2426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:00.645385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79352d-6539-438d-876c-0dd6886f2426 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:00.661433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1112/2236] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:00.671346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3f3d-2393-4235-9273-eb2285279bf4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.671701 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3f3d-2393-4235-9273-eb2285279bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.671988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3f3d-2393-4235-9273-eb2285279bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.685103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1125/2237] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:24:00 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:24:00.692602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79352d-6539-438d-876c-0dd6886f2426 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.702502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6e2d3f3d-2393-4235-9273-eb2285279bf4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:00.705285 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6e2d3f3d-2393-4235-9273-eb2285279bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:00.804620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1113/2238] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:00.812423 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d3f3d-2393-4235-9273-eb2285279bf4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.830194 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d3f3d-2393-4235-9273-eb2285279bf4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:00.833427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79352d-6539-438d-876c-0dd6886f2426 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:00.837399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63016b4-5a7a-4d1e-827e-6f7ccd364e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:00.838175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63016b4-5a7a-4d1e-827e-6f7ccd364e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.838535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63016b4-5a7a-4d1e-827e-6f7ccd364e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.838801 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63016b4-5a7a-4d1e-827e-6f7ccd364e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.839314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7642-bfdf-4e83-8ab6-84e7ccd17672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:00.840009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7642-bfdf-4e83-8ab6-84e7ccd17672 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.840134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63016b4-5a7a-4d1e-827e-6f7ccd364e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:24:00.840347 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63016b4-5a7a-4d1e-827e-6f7ccd364e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:00.840480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7642-bfdf-4e83-8ab6-84e7ccd17672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.840891 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf7642-bfdf-4e83-8ab6-84e7ccd17672 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.841602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf7642-bfdf-4e83-8ab6-84e7ccd17672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:00.842011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63016b4-5a7a-4d1e-827e-6f7ccd364e7b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:00.843743 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf7642-bfdf-4e83-8ab6-84e7ccd17672 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:00.858177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1114/2239] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:24:00.861374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63016b4-5a7a-4d1e-827e-6f7ccd364e7b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.870361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1126/2240] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:24:00 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:24:00.874173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7642-bfdf-4e83-8ab6-84e7ccd17672 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.874990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63016b4-5a7a-4d1e-827e-6f7ccd364e7b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:00.884226 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55509145-a5cf-4e08-856a-af8722fe5e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:00.884910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509145-a5cf-4e08-856a-af8722fe5e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.885364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509145-a5cf-4e08-856a-af8722fe5e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.885639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509145-a5cf-4e08-856a-af8722fe5e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.886646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55509145-a5cf-4e08-856a-af8722fe5e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:00.888127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf7642-bfdf-4e83-8ab6-84e7ccd17672 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:00.888644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55509145-a5cf-4e08-856a-af8722fe5e52 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:00.895482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560ee5a-5d43-4214-992c-76f50a5d427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:00.896901 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ee5a-5d43-4214-992c-76f50a5d427a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.897316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ee5a-5d43-4214-992c-76f50a5d427a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.897720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ee5a-5d43-4214-992c-76f50a5d427a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.898560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560ee5a-5d43-4214-992c-76f50a5d427a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:00.900694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560ee5a-5d43-4214-992c-76f50a5d427a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:00.917979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:00.918706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1127/2241] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:24:00.921674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560ee5a-5d43-4214-992c-76f50a5d427a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.936894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560ee5a-5d43-4214-992c-76f50a5d427a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:00.944429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e088d48-42a9-43ad-9d02-30fedb431449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:00.945179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088d48-42a9-43ad-9d02-30fedb431449 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:00.945602 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088d48-42a9-43ad-9d02-30fedb431449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:00.945966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088d48-42a9-43ad-9d02-30fedb431449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:00.946913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e088d48-42a9-43ad-9d02-30fedb431449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:00.949108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e088d48-42a9-43ad-9d02-30fedb431449 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:00.950311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1115/2242] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:24:00 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:24:00.951971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55509145-a5cf-4e08-856a-af8722fe5e52 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.963320 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1128/2243] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:24:00.986271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e088d48-42a9-43ad-9d02-30fedb431449 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:00.991787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e088d48-42a9-43ad-9d02-30fedb431449 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:01.043887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55509145-a5cf-4e08-856a-af8722fe5e52 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:01.050733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f021907-3d33-459a-9b0b-f4bfa061f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:01.051330 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021907-3d33-459a-9b0b-f4bfa061f413 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:01.051756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021907-3d33-459a-9b0b-f4bfa061f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:01.052120 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021907-3d33-459a-9b0b-f4bfa061f413 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:01.052662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021907-3d33-459a-9b0b-f4bfa061f413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:01.054742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021907-3d33-459a-9b0b-f4bfa061f413 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:01.067399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a04e3-f0cb-43c2-be92-4b000c37a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:01.068135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a04e3-f0cb-43c2-be92-4b000c37a3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:01.068422 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a04e3-f0cb-43c2-be92-4b000c37a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:01.068698 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a04e3-f0cb-43c2-be92-4b000c37a3e4 admin admin] PATH_INFO: `/v3/projects/38a776c6780e40098f4c3171b157f77a/users/74c78b3db906437cbac569ba4a352771/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:01.090131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1116/2244] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:24:00 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:24:01.093759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f021907-3d33-459a-9b0b-f4bfa061f413 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:01.099443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a04e3-f0cb-43c2-be92-4b000c37a3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a776c6780e40098f4c3171b157f77a, user_id=74c78b3db906437cbac569ba4a352771, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:01.102382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a04e3-f0cb-43c2-be92-4b000c37a3e4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:01.107152 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f021907-3d33-459a-9b0b-f4bfa061f413 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:01.113517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f54c4-f3f7-46fd-b885-8a48860d89a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:01.114350 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f54c4-f3f7-46fd-b885-8a48860d89a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:01.114485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f54c4-f3f7-46fd-b885-8a48860d89a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:01.114714 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f54c4-f3f7-46fd-b885-8a48860d89a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:01.115446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f54c4-f3f7-46fd-b885-8a48860d89a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:01.117154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f54c4-f3f7-46fd-b885-8a48860d89a0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:01.118531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1129/2245] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:24:00 2022] PUT /identity/v3/projects/38a776c6780e40098f4c3171b157f77a/users/74c78b3db906437cbac569ba4a352771/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:24:01.124858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14641ffd-0655-410b-b776-5773cbceb020 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:01.125412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14641ffd-0655-410b-b776-5773cbceb020 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:01.125526 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14641ffd-0655-410b-b776-5773cbceb020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:01.133917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1117/2246] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:24:01.134606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:01.134860 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f54c4-f3f7-46fd-b885-8a48860d89a0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:01.147055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f54c4-f3f7-46fd-b885-8a48860d89a0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:01.150404 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-14641ffd-0655-410b-b776-5773cbceb020 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:01.151655 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14641ffd-0655-410b-b776-5773cbceb020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:01.227659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f9c1d-90ea-42ff-9834-69f3df8685ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:01.228274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f9c1d-90ea-42ff-9834-69f3df8685ff admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:01.228560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f9c1d-90ea-42ff-9834-69f3df8685ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:01.228878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f9c1d-90ea-42ff-9834-69f3df8685ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:01.229483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f9c1d-90ea-42ff-9834-69f3df8685ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:01.231122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f9c1d-90ea-42ff-9834-69f3df8685ff admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:01.231512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1130/2247] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:24:01.241990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14641ffd-0655-410b-b776-5773cbceb020 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:01.242457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1118/2248] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:24:01.243518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14641ffd-0655-410b-b776-5773cbceb020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:01.246281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f9c1d-90ea-42ff-9834-69f3df8685ff admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:01.259163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f9c1d-90ea-42ff-9834-69f3df8685ff admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:01.265247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e953db-4539-473b-9911-839f9672fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:01.266006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e953db-4539-473b-9911-839f9672fbfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:01.266571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e953db-4539-473b-9911-839f9672fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:01.266571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e953db-4539-473b-9911-839f9672fbfc admin admin] PATH_INFO: `/v3/projects/05bfd79b092142a085d1c0acf8a8ccd6/users/62dd7c07c70e4ef9bfca2687a91e7adf/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:01.289211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e953db-4539-473b-9911-839f9672fbfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bfd79b092142a085d1c0acf8a8ccd6, user_id=62dd7c07c70e4ef9bfca2687a91e7adf, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:01.292828 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e953db-4539-473b-9911-839f9672fbfc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:01.320134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1119/2249] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:24:01 2022] PUT /identity/v3/projects/05bfd79b092142a085d1c0acf8a8ccd6/users/62dd7c07c70e4ef9bfca2687a91e7adf/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:24:01.320355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14641ffd-0655-410b-b776-5773cbceb020 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:01.321864 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d824b1b-f1a6-4f6c-b40d-28f89aad36a5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:01.322197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d824b1b-f1a6-4f6c-b40d-28f89aad36a5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:01.322479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d824b1b-f1a6-4f6c-b40d-28f89aad36a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:01.343332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2d824b1b-f1a6-4f6c-b40d-28f89aad36a5 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:01.344527 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2d824b1b-f1a6-4f6c-b40d-28f89aad36a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:01.379640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92f62a-414a-4449-9cc9-b55e8c56b910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:01.380501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92f62a-414a-4449-9cc9-b55e8c56b910 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:01.380820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92f62a-414a-4449-9cc9-b55e8c56b910 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:01.381095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92f62a-414a-4449-9cc9-b55e8c56b910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:01.398307 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:01.429414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1120/2250] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:24:01.439321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d824b1b-f1a6-4f6c-b40d-28f89aad36a5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:01.451205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d824b1b-f1a6-4f6c-b40d-28f89aad36a5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:01.460667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbec80-3e88-42c2-814e-8f4f46c655b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:01.460667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbec80-3e88-42c2-814e-8f4f46c655b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:01.460667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbec80-3e88-42c2-814e-8f4f46c655b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:01.460667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbec80-3e88-42c2-814e-8f4f46c655b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:01.468873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbec80-3e88-42c2-814e-8f4f46c655b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:01.470669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbec80-3e88-42c2-814e-8f4f46c655b9 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:01.476415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92f62a-414a-4449-9cc9-b55e8c56b910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:01.477954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92f62a-414a-4449-9cc9-b55e8c56b910 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:01.486022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1121/2251] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:24:01.490865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1131/2252] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:24:01.747460 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b667ea-a290-451b-b2d3-8766e9fe7cee None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:01.747749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b667ea-a290-451b-b2d3-8766e9fe7cee None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:01.748027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b667ea-a290-451b-b2d3-8766e9fe7cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:01.777523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-45b667ea-a290-451b-b2d3-8766e9fe7cee None None] MFA Rules not processed for user `d86b39b1bf7546dea03dbf180ab567e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:01.778482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-45b667ea-a290-451b-b2d3-8766e9fe7cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:01.855908 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1122/2253] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:01.869421 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92f62a-414a-4449-9cc9-b55e8c56b910 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:01.871316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7b92f62a-414a-4449-9cc9-b55e8c56b910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:01.884059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:01.961261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92f62a-414a-4449-9cc9-b55e8c56b910 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:01.965489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc4cf5-1ffe-4168-89a9-e5bfc9804868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:01.966218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc4cf5-1ffe-4168-89a9-e5bfc9804868 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:01.966500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc4cf5-1ffe-4168-89a9-e5bfc9804868 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:01.966787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc4cf5-1ffe-4168-89a9-e5bfc9804868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:01.978077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc4cf5-1ffe-4168-89a9-e5bfc9804868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:01.979925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc4cf5-1ffe-4168-89a9-e5bfc9804868 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:01.993400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1132/2254] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:24:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:24:03.415061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbce53-05fd-4b02-8af5-8c8a70c692c1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:03.415655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbce53-05fd-4b02-8af5-8c8a70c692c1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:03.415655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbce53-05fd-4b02-8af5-8c8a70c692c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:03.446804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-38cbce53-05fd-4b02-8af5-8c8a70c692c1 None None] MFA Rules not processed for user `74c78b3db906437cbac569ba4a352771`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:03.448036 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-38cbce53-05fd-4b02-8af5-8c8a70c692c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:03.547384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda403cb-bab5-45de-8e2d-1b97adc11fcd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:03.547899 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda403cb-bab5-45de-8e2d-1b97adc11fcd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:03.548123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda403cb-bab5-45de-8e2d-1b97adc11fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:03.580823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1123/2255] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:03.589456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eda403cb-bab5-45de-8e2d-1b97adc11fcd None None] MFA Rules not processed for user `d86b39b1bf7546dea03dbf180ab567e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:03.591205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eda403cb-bab5-45de-8e2d-1b97adc11fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:03.595146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbce53-05fd-4b02-8af5-8c8a70c692c1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:03.597359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-38cbce53-05fd-4b02-8af5-8c8a70c692c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:03.605308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1133/2256] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:03.612375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbce53-05fd-4b02-8af5-8c8a70c692c1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:03.616482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10c0a6-dc37-4736-aa8d-e713b577c303 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:03.617337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10c0a6-dc37-4736-aa8d-e713b577c303 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:03.617880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10c0a6-dc37-4736-aa8d-e713b577c303 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:03.618244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10c0a6-dc37-4736-aa8d-e713b577c303 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:03.629064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10c0a6-dc37-4736-aa8d-e713b577c303 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:03.630778 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10c0a6-dc37-4736-aa8d-e713b577c303 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:03.640377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1124/2257] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:24:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:24:04.048478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda403cb-bab5-45de-8e2d-1b97adc11fcd None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:04.050612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eda403cb-bab5-45de-8e2d-1b97adc11fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:04.081201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda403cb-bab5-45de-8e2d-1b97adc11fcd None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:04.091802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:04.093882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:04.094555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:04.095830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] PATH_INFO: `/v3/users/aeee54dd5c584962a743ea7e91cfa221` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:04.097294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeee54dd5c584962a743ea7e91cfa221)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:04.099724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:04.192140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeee54dd5c584962a743ea7e91cfa221'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:04.204070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeee54dd5c584962a743ea7e91cfa221'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:04.239581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeee54dd5c584962a743ea7e91cfa221'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:04.250804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeee54dd5c584962a743ea7e91cfa221'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:04.251713 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeee54dd5c584962a743ea7e91cfa221'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:04.261480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1134/2258] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:24:04 2022] DELETE /identity/v3/users/aeee54dd5c584962a743ea7e91cfa221 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:24:04.265881 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f267-63c9-4e3f-8b79-827e372a48e7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:04.266210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f267-63c9-4e3f-8b79-827e372a48e7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:04.266490 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f267-63c9-4e3f-8b79-827e372a48e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:04.291161 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1776f267-63c9-4e3f-8b79-827e372a48e7 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:04.292816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1776f267-63c9-4e3f-8b79-827e372a48e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:04.348426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:04.413373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1125/2259] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:04.431207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:04.432944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:04.544583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d967ab-be63-4f74-b68e-00e727a2ec49 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:04.548622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcefa1f-1863-4215-bbd5-7e5e33e1874d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:04.549260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcefa1f-1863-4215-bbd5-7e5e33e1874d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:04.549546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcefa1f-1863-4215-bbd5-7e5e33e1874d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:04.550434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcefa1f-1863-4215-bbd5-7e5e33e1874d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:04.567248 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcefa1f-1863-4215-bbd5-7e5e33e1874d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:04.568867 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcefa1f-1863-4215-bbd5-7e5e33e1874d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:04.579539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1135/2260] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:24:04.894995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776f267-63c9-4e3f-8b79-827e372a48e7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:04.896574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1776f267-63c9-4e3f-8b79-827e372a48e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:04.910366 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776f267-63c9-4e3f-8b79-827e372a48e7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:04.915602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:04.916763 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:04.917099 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:04.917317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] PATH_INFO: `/v3/projects/b226f856c3f049c38c7ece18953018e1` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:04.918956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b226f856c3f049c38c7ece18953018e1)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:04.920949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:05.002988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b226f856c3f049c38c7ece18953018e1', 'request_id': 'req-41292753-03a0-40e7-9a1b-3217cf55ddfa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:05.014998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b226f856c3f049c38c7ece18953018e1', 'request_id': 'req-41292753-03a0-40e7-9a1b-3217cf55ddfa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:05.032798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b226f856c3f049c38c7ece18953018e1', 'request_id': 'req-41292753-03a0-40e7-9a1b-3217cf55ddfa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:05.053467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] The token cache is being invalidate because project b226f856c3f049c38c7ece18953018e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:24:05.055595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:05.056536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-41292753-03a0-40e7-9a1b-3217cf55ddfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:24:05.058830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1126/2261] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:24:04 2022] DELETE /identity/v3/projects/b226f856c3f049c38c7ece18953018e1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:24:05.147314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2eadb-403e-4fe1-95fb-33e10ceddc92 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:05.147585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2eadb-403e-4fe1-95fb-33e10ceddc92 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:05.147869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2eadb-403e-4fe1-95fb-33e10ceddc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:05.182059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-87f2eadb-403e-4fe1-95fb-33e10ceddc92 None None] MFA Rules not processed for user `74c78b3db906437cbac569ba4a352771`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:05.183438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-87f2eadb-403e-4fe1-95fb-33e10ceddc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:05.204445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:05.294232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1136/2262] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:10.442878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030b147-a595-473f-9ea0-3e9ddaea01b4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:10.443399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030b147-a595-473f-9ea0-3e9ddaea01b4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:10.443503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030b147-a595-473f-9ea0-3e9ddaea01b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:10.470979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3030b147-a595-473f-9ea0-3e9ddaea01b4 None None] MFA Rules not processed for user `336b111f4b854a21ad3d9fe8fcff6f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:10.472819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3030b147-a595-473f-9ea0-3e9ddaea01b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:10.537179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124130bf-98b3-499c-876b-bae09599a48a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:10.537759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124130bf-98b3-499c-876b-bae09599a48a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:10.537902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124130bf-98b3-499c-876b-bae09599a48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:10.561807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1127/2263] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:10.605935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-124130bf-98b3-499c-876b-bae09599a48a None None] MFA Rules not processed for user `62dd7c07c70e4ef9bfca2687a91e7adf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:10.609227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-124130bf-98b3-499c-876b-bae09599a48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:10.767593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1137/2264] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:24:10.772838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030b147-a595-473f-9ea0-3e9ddaea01b4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:10.775004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3030b147-a595-473f-9ea0-3e9ddaea01b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:10.906609 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030b147-a595-473f-9ea0-3e9ddaea01b4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:10.912966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eea1ac-8fe8-48a0-90e1-fce6c6a3b295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:10.913812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eea1ac-8fe8-48a0-90e1-fce6c6a3b295 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:10.914339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eea1ac-8fe8-48a0-90e1-fce6c6a3b295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:10.914768 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eea1ac-8fe8-48a0-90e1-fce6c6a3b295 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:10.915714 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eea1ac-8fe8-48a0-90e1-fce6c6a3b295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:10.917847 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eea1ac-8fe8-48a0-90e1-fce6c6a3b295 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:10.937862 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:10.961272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1128/2265] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:24:10 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:24:10.963531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124130bf-98b3-499c-876b-bae09599a48a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:10.977134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124130bf-98b3-499c-876b-bae09599a48a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:11.043156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ecb7f-e1f6-4599-a276-fc91b2a7921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:11.043668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ecb7f-e1f6-4599-a276-fc91b2a7921e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:11.043956 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ecb7f-e1f6-4599-a276-fc91b2a7921e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:11.044412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ecb7f-e1f6-4599-a276-fc91b2a7921e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:11.045087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ecb7f-e1f6-4599-a276-fc91b2a7921e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:11.047423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ecb7f-e1f6-4599-a276-fc91b2a7921e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:11.080183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1138/2266] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:24:10 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:24:11.082915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eea1ac-8fe8-48a0-90e1-fce6c6a3b295 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:11.104469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eea1ac-8fe8-48a0-90e1-fce6c6a3b295 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:11.113437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5a26a-c6c5-4002-be29-27adfb1921b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:11.114559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5a26a-c6c5-4002-be29-27adfb1921b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:11.116588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5a26a-c6c5-4002-be29-27adfb1921b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:11.118008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5a26a-c6c5-4002-be29-27adfb1921b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:11.119505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5a26a-c6c5-4002-be29-27adfb1921b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:11.123262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5a26a-c6c5-4002-be29-27adfb1921b0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:11.147501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1129/2267] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:24:11.150871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ecb7f-e1f6-4599-a276-fc91b2a7921e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:11.162458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ecb7f-e1f6-4599-a276-fc91b2a7921e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:11.168298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ec4dc-31fa-4d7b-9943-623057f50555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:11.168975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ec4dc-31fa-4d7b-9943-623057f50555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:11.169255 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ec4dc-31fa-4d7b-9943-623057f50555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:11.169528 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ec4dc-31fa-4d7b-9943-623057f50555 admin admin] PATH_INFO: `/v3/projects/48aec5a397b9496fbb938745d25e96ad/users/ae06a907710b476e8dd9a0b26fd064da/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:11.189422 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ec4dc-31fa-4d7b-9943-623057f50555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48aec5a397b9496fbb938745d25e96ad, user_id=ae06a907710b476e8dd9a0b26fd064da, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:11.193237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ec4dc-31fa-4d7b-9943-623057f50555 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:11.210348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1139/2268] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:24:11 2022] PUT /identity/v3/projects/48aec5a397b9496fbb938745d25e96ad/users/ae06a907710b476e8dd9a0b26fd064da/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:24:11.214253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5a26a-c6c5-4002-be29-27adfb1921b0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:11.226548 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5a26a-c6c5-4002-be29-27adfb1921b0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:11.305520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226483f-f9fc-4480-a38f-f8483773c098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:11.306395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226483f-f9fc-4480-a38f-f8483773c098 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:11.306776 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226483f-f9fc-4480-a38f-f8483773c098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:11.307398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226483f-f9fc-4480-a38f-f8483773c098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:11.308068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226483f-f9fc-4480-a38f-f8483773c098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:11.309834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226483f-f9fc-4480-a38f-f8483773c098 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:11.324328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1130/2269] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:24:11.331879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ec4dc-31fa-4d7b-9943-623057f50555 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:11.364982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ec4dc-31fa-4d7b-9943-623057f50555 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:11.381201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99dd57b-b6e4-4444-9010-98380cc86fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:11.382225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dd57b-b6e4-4444-9010-98380cc86fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:11.382695 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dd57b-b6e4-4444-9010-98380cc86fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:11.383175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dd57b-b6e4-4444-9010-98380cc86fa4 admin admin] PATH_INFO: `/v3/projects/48aec5a397b9496fbb938745d25e96ad/users/ae06a907710b476e8dd9a0b26fd064da/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:11.388169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dd57b-b6e4-4444-9010-98380cc86fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48aec5a397b9496fbb938745d25e96ad, user_id=ae06a907710b476e8dd9a0b26fd064da, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:11.392948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99dd57b-b6e4-4444-9010-98380cc86fa4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:11.429513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1140/2270] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:24:11 2022] PUT /identity/v3/projects/48aec5a397b9496fbb938745d25e96ad/users/ae06a907710b476e8dd9a0b26fd064da/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:24:15.847489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134760-d645-4c47-94a9-4a1ee5dca990 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:15.860946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134760-d645-4c47-94a9-4a1ee5dca990 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:15.863375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68134760-d645-4c47-94a9-4a1ee5dca990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:15.889658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-68134760-d645-4c47-94a9-4a1ee5dca990 None None] MFA Rules not processed for user `c2c4ba36ac1240e0bbca86690a69b64c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:15.891534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-68134760-d645-4c47-94a9-4a1ee5dca990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:15.968578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1131/2271] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:21.172306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d74fd-7541-4c41-b730-a4a05b1865c9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:21.173867 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d74fd-7541-4c41-b730-a4a05b1865c9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:21.174200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d74fd-7541-4c41-b730-a4a05b1865c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:21.203247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:21.211682 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-314d74fd-7541-4c41-b730-a4a05b1865c9 None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:21.214232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-314d74fd-7541-4c41-b730-a4a05b1865c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:21.308014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1141/2272] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:21.384648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134760-d645-4c47-94a9-4a1ee5dca990 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:21.386867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-68134760-d645-4c47-94a9-4a1ee5dca990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:21.519637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68134760-d645-4c47-94a9-4a1ee5dca990 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:21.536288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827921bf-a351-4407-a05f-3344eb87e074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:21.537122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827921bf-a351-4407-a05f-3344eb87e074 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:21.538002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827921bf-a351-4407-a05f-3344eb87e074 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:21.538460 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827921bf-a351-4407-a05f-3344eb87e074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:21.550397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827921bf-a351-4407-a05f-3344eb87e074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:21.553036 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827921bf-a351-4407-a05f-3344eb87e074 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:21.585597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633058dd-494f-4d9a-b9f0-859ceb286ace None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:21.585838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633058dd-494f-4d9a-b9f0-859ceb286ace None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:21.586151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633058dd-494f-4d9a-b9f0-859ceb286ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:21.587702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1132/2273] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:24:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:24:21.659330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-633058dd-494f-4d9a-b9f0-859ceb286ace None None] MFA Rules not processed for user `ae06a907710b476e8dd9a0b26fd064da`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:21.660618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-633058dd-494f-4d9a-b9f0-859ceb286ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:21.806856 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1142/2274] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:22.434396 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827921bf-a351-4407-a05f-3344eb87e074 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:22.435911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-827921bf-a351-4407-a05f-3344eb87e074 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:22.457117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:22.657439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827921bf-a351-4407-a05f-3344eb87e074 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:22.665335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc1d6f-f779-4637-bc71-5725ce0130e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:22.666533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc1d6f-f779-4637-bc71-5725ce0130e5 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:22.667030 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc1d6f-f779-4637-bc71-5725ce0130e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:22.667509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc1d6f-f779-4637-bc71-5725ce0130e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:22.763147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc1d6f-f779-4637-bc71-5725ce0130e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:22.765256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc1d6f-f779-4637-bc71-5725ce0130e5 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:22.779605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1133/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:24:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:24:25.194069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda969a9-3621-49db-a949-bc95a804a5ac None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:25.194616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda969a9-3621-49db-a949-bc95a804a5ac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:25.196795 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda969a9-3621-49db-a949-bc95a804a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:25.239250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-cda969a9-3621-49db-a949-bc95a804a5ac None None] MFA Rules not processed for user `62dd7c07c70e4ef9bfca2687a91e7adf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:25.241678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cda969a9-3621-49db-a949-bc95a804a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:25.255350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1143/2276] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:24:32.774213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=50 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:35.226504 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d646f-b1ea-4ccf-9beb-c0c6e11e2d5d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:35.227093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d646f-b1ea-4ccf-9beb-c0c6e11e2d5d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:35.227093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d646f-b1ea-4ccf-9beb-c0c6e11e2d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:35.229180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=59 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:35.250616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-828d646f-b1ea-4ccf-9beb-c0c6e11e2d5d None None] MFA Rules not processed for user `74c78b3db906437cbac569ba4a352771`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:35.251775 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-828d646f-b1ea-4ccf-9beb-c0c6e11e2d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:35.355645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1134/2277] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:24:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:42.037359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479887f0-ba28-416a-87ac-9b3638232f5e None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:42.037898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479887f0-ba28-416a-87ac-9b3638232f5e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:42.038139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479887f0-ba28-416a-87ac-9b3638232f5e None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:42.039516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1144/2278] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:24:42.047771 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af35a57-061f-4a8b-bd78-836e6e1db1f9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:42.048269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af35a57-061f-4a8b-bd78-836e6e1db1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:42.048420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af35a57-061f-4a8b-bd78-836e6e1db1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:42.071856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9af35a57-061f-4a8b-bd78-836e6e1db1f9 None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:42.073083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9af35a57-061f-4a8b-bd78-836e6e1db1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:42.097419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1135/2279] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:24:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:24:42.129554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479887f0-ba28-416a-87ac-9b3638232f5e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:42.131597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-479887f0-ba28-416a-87ac-9b3638232f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:42.204589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479887f0-ba28-416a-87ac-9b3638232f5e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:42.208960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a045b-b478-47fd-b9aa-7e981833e9cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23bb3a6586247e0a11ece33569d6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:42.209846 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a045b-b478-47fd-b9aa-7e981833e9cc service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:42.210378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a045b-b478-47fd-b9aa-7e981833e9cc service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:42.210841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a045b-b478-47fd-b9aa-7e981833e9cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:42.226257 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a045b-b478-47fd-b9aa-7e981833e9cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:42.227886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a045b-b478-47fd-b9aa-7e981833e9cc service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:42.239842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1145/2280] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:24:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:24:42.309774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667def2e-28ba-4127-b858-fa2790efb776 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:42.310146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667def2e-28ba-4127-b858-fa2790efb776 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:42.310414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667def2e-28ba-4127-b858-fa2790efb776 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:42.311745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1136/2281] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:24:42.316855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3f8ec-a222-41b2-b421-7c5d024097dd None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:42.317334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3f8ec-a222-41b2-b421-7c5d024097dd None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:42.317676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3f8ec-a222-41b2-b421-7c5d024097dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:42.338169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-05d3f8ec-a222-41b2-b421-7c5d024097dd None None] MFA Rules not processed for user `a220cf4fafe84d6498bc959a9cd18df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:42.339391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-05d3f8ec-a222-41b2-b421-7c5d024097dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:42.393253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1146/2282] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:24:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:24:42.404899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667def2e-28ba-4127-b858-fa2790efb776 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:42.406599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-667def2e-28ba-4127-b858-fa2790efb776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:42.420434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667def2e-28ba-4127-b858-fa2790efb776 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:42.423984 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7386-f7a6-4bfd-b45e-8883c7bfefa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:42.424645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7386-f7a6-4bfd-b45e-8883c7bfefa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:42.424988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7386-f7a6-4bfd-b45e-8883c7bfefa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:42.425321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7386-f7a6-4bfd-b45e-8883c7bfefa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:42.433034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d7386-f7a6-4bfd-b45e-8883c7bfefa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:42.434582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d7386-f7a6-4bfd-b45e-8883c7bfefa0 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:42.442747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1137/2283] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:24:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:24:42.529982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94793-ef8c-4d66-b518-e2d686185299 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:42.532526 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94793-ef8c-4d66-b518-e2d686185299 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:42.532883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca94793-ef8c-4d66-b518-e2d686185299 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:42.534983 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1147/2284] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:24:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:24:42.540767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742b9bf-8419-40b8-9f87-7fcfe5f78f82 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:42.541259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742b9bf-8419-40b8-9f87-7fcfe5f78f82 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:42.541529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742b9bf-8419-40b8-9f87-7fcfe5f78f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:42.561317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3742b9bf-8419-40b8-9f87-7fcfe5f78f82 None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:42.562551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3742b9bf-8419-40b8-9f87-7fcfe5f78f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:42.571749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1138/2285] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:24:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:42.582498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94793-ef8c-4d66-b518-e2d686185299 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:42.594885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca94793-ef8c-4d66-b518-e2d686185299 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:42.599558 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08754c-9512-4681-84e8-b17cb2cfc047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:42.600158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08754c-9512-4681-84e8-b17cb2cfc047 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:42.600434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08754c-9512-4681-84e8-b17cb2cfc047 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:42.600702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08754c-9512-4681-84e8-b17cb2cfc047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:42.614831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08754c-9512-4681-84e8-b17cb2cfc047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:42.617256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08754c-9512-4681-84e8-b17cb2cfc047 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:42.631312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1148/2286] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:24:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:24:46.680545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e29ff-031b-4e9e-b45e-d27531c5874d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:46.680980 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e29ff-031b-4e9e-b45e-d27531c5874d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:46.681141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e29ff-031b-4e9e-b45e-d27531c5874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:46.700475 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b29e29ff-031b-4e9e-b45e-d27531c5874d None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:24:46.701676 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b29e29ff-031b-4e9e-b45e-d27531c5874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:24:46.708930 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1139/2287] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:24:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:24:46.722403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08754c-9512-4681-84e8-b17cb2cfc047 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:24:46.735195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08754c-9512-4681-84e8-b17cb2cfc047 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:24:46.742460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4405180-9eed-4bae-af35-08949da020b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:24:46.743140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4405180-9eed-4bae-af35-08949da020b6 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:24:46.743757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4405180-9eed-4bae-af35-08949da020b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:24:46.744105 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4405180-9eed-4bae-af35-08949da020b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:24:46.753670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4405180-9eed-4bae-af35-08949da020b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:24:46.755504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4405180-9eed-4bae-af35-08949da020b6 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:24:46.764101 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1149/2288] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:24:56.695400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=40 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:24:56.760617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=61 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:07.625095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbebfc-609e-4f50-99de-312dd62be005 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:07.625614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbebfc-609e-4f50-99de-312dd62be005 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:07.625695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbebfc-609e-4f50-99de-312dd62be005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:07.647262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-58fbebfc-609e-4f50-99de-312dd62be005 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:25:07.648573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-58fbebfc-609e-4f50-99de-312dd62be005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:07.751700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1140/2289] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 19 15:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:25:07.894056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4405180-9eed-4bae-af35-08949da020b6 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:07.900774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e4405180-9eed-4bae-af35-08949da020b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:07.936135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4405180-9eed-4bae-af35-08949da020b6 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:07.946262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e0510-941a-414f-879f-12efb82c8bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:07.947860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0510-941a-414f-879f-12efb82c8bbe service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:07.948582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0510-941a-414f-879f-12efb82c8bbe service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:07.949845 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e0510-941a-414f-879f-12efb82c8bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:07.962258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e0510-941a-414f-879f-12efb82c8bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:07.964846 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e0510-941a-414f-879f-12efb82c8bbe service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:07.977611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1150/2290] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:25:10.429369 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac120cc-530d-477f-b151-8058eec51276 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:10.429832 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac120cc-530d-477f-b151-8058eec51276 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:10.429933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac120cc-530d-477f-b151-8058eec51276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:10.450694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-dac120cc-530d-477f-b151-8058eec51276 None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:25:10.451910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dac120cc-530d-477f-b151-8058eec51276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:10.459608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1141/2291] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 19 15:25:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:25:10.471864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e0510-941a-414f-879f-12efb82c8bbe service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:10.483446 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e0510-941a-414f-879f-12efb82c8bbe service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:10.488540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97185df-3430-4c91-bedb-834e32a91856 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:10.489128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97185df-3430-4c91-bedb-834e32a91856 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:10.489438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97185df-3430-4c91-bedb-834e32a91856 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:10.489712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97185df-3430-4c91-bedb-834e32a91856 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:10.497479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97185df-3430-4c91-bedb-834e32a91856 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:10.499083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97185df-3430-4c91-bedb-834e32a91856 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:10.507357 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1151/2292] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:25:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:25:12.863252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac120cc-530d-477f-b151-8058eec51276 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:12.866142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-dac120cc-530d-477f-b151-8058eec51276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:12.951641 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac120cc-530d-477f-b151-8058eec51276 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:12.957125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1133b2e-e7c8-46d0-81da-cb0a899f9925 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2862a661174142d69bbdd54ee0289681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:12.957817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1133b2e-e7c8-46d0-81da-cb0a899f9925 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:12.958790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1133b2e-e7c8-46d0-81da-cb0a899f9925 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:12.959156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1133b2e-e7c8-46d0-81da-cb0a899f9925 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:12.960975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f1133b2e-e7c8-46d0-81da-cb0a899f9925 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:12.975312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1133b2e-e7c8-46d0-81da-cb0a899f9925 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:12.977172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1133b2e-e7c8-46d0-81da-cb0a899f9925 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:12.989167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1142/2293] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:25:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:25:13.751500 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb0b13-7969-464d-bab8-ac5b5f861a0b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:13.751973 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb0b13-7969-464d-bab8-ac5b5f861a0b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:13.752065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb0b13-7969-464d-bab8-ac5b5f861a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:13.773831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-b9cb0b13-7969-464d-bab8-ac5b5f861a0b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:25:13.775114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b9cb0b13-7969-464d-bab8-ac5b5f861a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:13.785291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1152/2294] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 19 15:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:25:13.808068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1133b2e-e7c8-46d0-81da-cb0a899f9925 service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:13.822658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1133b2e-e7c8-46d0-81da-cb0a899f9925 service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:13.829598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f498f-1d6a-4893-bdc4-3b914fac63f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:13.830243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f498f-1d6a-4893-bdc4-3b914fac63f9 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:13.830509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f498f-1d6a-4893-bdc4-3b914fac63f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:13.830782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f498f-1d6a-4893-bdc4-3b914fac63f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:13.839456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f498f-1d6a-4893-bdc4-3b914fac63f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:13.841046 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f498f-1d6a-4893-bdc4-3b914fac63f9 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:13.852368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1143/2295] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:25:15.524022 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f63c-8a8d-4f5e-b366-591d7e1d4b1f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:15.524488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f63c-8a8d-4f5e-b366-591d7e1d4b1f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:15.524603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f63c-8a8d-4f5e-b366-591d7e1d4b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:15.543837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3d83f63c-8a8d-4f5e-b366-591d7e1d4b1f None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:25:15.545065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3d83f63c-8a8d-4f5e-b366-591d7e1d4b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:15.552812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1153/2296] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:25:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:25:15.565786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f498f-1d6a-4893-bdc4-3b914fac63f9 service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:15.577560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f498f-1d6a-4893-bdc4-3b914fac63f9 service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:15.582488 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66c4c8-bc7c-4332-a0ca-e6af85dfe687 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:15.583104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66c4c8-bc7c-4332-a0ca-e6af85dfe687 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:15.583381 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66c4c8-bc7c-4332-a0ca-e6af85dfe687 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:15.583683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66c4c8-bc7c-4332-a0ca-e6af85dfe687 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:15.591509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66c4c8-bc7c-4332-a0ca-e6af85dfe687 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:15.593130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66c4c8-bc7c-4332-a0ca-e6af85dfe687 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:15.601860 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1144/2297] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:25:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:25:19.304312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a48ad-4486-459c-856c-680a55fb23ed None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:19.304940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a48ad-4486-459c-856c-680a55fb23ed None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:19.305093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a48ad-4486-459c-856c-680a55fb23ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:19.333749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f60a48ad-4486-459c-856c-680a55fb23ed None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:25:19.335703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f60a48ad-4486-459c-856c-680a55fb23ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:19.347237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1154/2298] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 19 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:25:19.385454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66c4c8-bc7c-4332-a0ca-e6af85dfe687 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:19.399424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66c4c8-bc7c-4332-a0ca-e6af85dfe687 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:19.404913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4cd8-72b8-4745-86c5-00f3dfc1215f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:19.405524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4cd8-72b8-4745-86c5-00f3dfc1215f service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:19.405806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4cd8-72b8-4745-86c5-00f3dfc1215f service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:19.406113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4cd8-72b8-4745-86c5-00f3dfc1215f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:19.415321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd4cd8-72b8-4745-86c5-00f3dfc1215f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:19.417254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd4cd8-72b8-4745-86c5-00f3dfc1215f service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:19.427480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1145/2299] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:25:23.264554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95106b1-140b-4d3f-9efe-f1bdd30126bf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:23.265092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95106b1-140b-4d3f-9efe-f1bdd30126bf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:23.265092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95106b1-140b-4d3f-9efe-f1bdd30126bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:23.287629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d95106b1-140b-4d3f-9efe-f1bdd30126bf None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:25:23.289336 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d95106b1-140b-4d3f-9efe-f1bdd30126bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:23.299360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1155/2300] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 19 15:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:25:23.327471 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4cd8-72b8-4745-86c5-00f3dfc1215f service nova] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:23.340140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4cd8-72b8-4745-86c5-00f3dfc1215f service nova] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:23.346311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86424ef-4e84-4873-836a-c6fffebb98c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:23.346917 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86424ef-4e84-4873-836a-c6fffebb98c2 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:23.347202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86424ef-4e84-4873-836a-c6fffebb98c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:23.347481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86424ef-4e84-4873-836a-c6fffebb98c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:23.357407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86424ef-4e84-4873-836a-c6fffebb98c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:23.359198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86424ef-4e84-4873-836a-c6fffebb98c2 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:23.371018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1146/2301] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:25:25.141016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95106b1-140b-4d3f-9efe-f1bdd30126bf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:25.152283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95106b1-140b-4d3f-9efe-f1bdd30126bf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:25.156497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f334b-d7b5-448b-a58a-5eaa61b293f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:25.157674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f334b-d7b5-448b-a58a-5eaa61b293f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:25.158160 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f334b-d7b5-448b-a58a-5eaa61b293f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:25.158596 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f334b-d7b5-448b-a58a-5eaa61b293f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:25.171152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f334b-d7b5-448b-a58a-5eaa61b293f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:25.173398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f334b-d7b5-448b-a58a-5eaa61b293f5 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:25.186377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1156/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:25:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:25:28.657331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143ee78-1888-4ebc-a435-041d2cc62ba1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:28.657936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143ee78-1888-4ebc-a435-041d2cc62ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:28.658280 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143ee78-1888-4ebc-a435-041d2cc62ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:28.689941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e143ee78-1888-4ebc-a435-041d2cc62ba1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:25:28.693639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e143ee78-1888-4ebc-a435-041d2cc62ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:28.703792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1147/2303] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 19 15:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:25:28.731136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f334b-d7b5-448b-a58a-5eaa61b293f5 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:28.746210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f334b-d7b5-448b-a58a-5eaa61b293f5 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:28.752528 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3af94-7047-471e-be28-111a990b99fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:28.753409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3af94-7047-471e-be28-111a990b99fc service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:28.753858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3af94-7047-471e-be28-111a990b99fc service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:28.754648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3af94-7047-471e-be28-111a990b99fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:28.765459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3af94-7047-471e-be28-111a990b99fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:28.767140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3af94-7047-471e-be28-111a990b99fc service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:28.792286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1157/2304] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:25:31.999228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4a796-cc7e-4e63-a904-2b7536334f67 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:31.999686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4a796-cc7e-4e63-a904-2b7536334f67 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:31.999809 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4a796-cc7e-4e63-a904-2b7536334f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:32.018943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-26d4a796-cc7e-4e63-a904-2b7536334f67 None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:25:32.020205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-26d4a796-cc7e-4e63-a904-2b7536334f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:32.027416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1148/2305] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 19 15:25:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:25:32.041044 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3af94-7047-471e-be28-111a990b99fc service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:32.054594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3af94-7047-471e-be28-111a990b99fc service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:32.060426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8835b-0451-4bdb-a834-fce2226b7d0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:32.061018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8835b-0451-4bdb-a834-fce2226b7d0a service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:32.061293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8835b-0451-4bdb-a834-fce2226b7d0a service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:32.061560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8835b-0451-4bdb-a834-fce2226b7d0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:32.072709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8835b-0451-4bdb-a834-fce2226b7d0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:32.074841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8835b-0451-4bdb-a834-fce2226b7d0a service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:32.084128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1158/2306] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:25:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:25:32.882972 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252fe8-08e4-4958-85fe-a8cdbfa188ad None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:32.883254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252fe8-08e4-4958-85fe-a8cdbfa188ad None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:32.883524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38252fe8-08e4-4958-85fe-a8cdbfa188ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:32.904276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-38252fe8-08e4-4958-85fe-a8cdbfa188ad None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:25:32.905480 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-38252fe8-08e4-4958-85fe-a8cdbfa188ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:32.914110 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1149/2307] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 19 15:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:25:32.960289 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8835b-0451-4bdb-a834-fce2226b7d0a service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:32.972362 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8835b-0451-4bdb-a834-fce2226b7d0a service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:32.978120 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8cbb8-d291-400b-a5d6-5f6aafd08404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:32.978718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8cbb8-d291-400b-a5d6-5f6aafd08404 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:32.978997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8cbb8-d291-400b-a5d6-5f6aafd08404 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:32.979270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8cbb8-d291-400b-a5d6-5f6aafd08404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:32.988095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8cbb8-d291-400b-a5d6-5f6aafd08404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:32.989606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8cbb8-d291-400b-a5d6-5f6aafd08404 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:32.999904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1159/2308] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:25:34.000112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38252fe8-08e4-4958-85fe-a8cdbfa188ad None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:34.001690 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-38252fe8-08e4-4958-85fe-a8cdbfa188ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:34.015738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38252fe8-08e4-4958-85fe-a8cdbfa188ad None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:34.020846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f08bd-6d18-4143-96a2-b12e0ff70337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:34.021473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f08bd-6d18-4143-96a2-b12e0ff70337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:34.021782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f08bd-6d18-4143-96a2-b12e0ff70337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:34.022125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f08bd-6d18-4143-96a2-b12e0ff70337 admin admin] PATH_INFO: `/v3/users/74c78b3db906437cbac569ba4a352771` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:34.023314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f08bd-6d18-4143-96a2-b12e0ff70337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c78b3db906437cbac569ba4a352771)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:34.025252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f08bd-6d18-4143-96a2-b12e0ff70337 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:34.029955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:34.072852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8f9f08bd-6d18-4143-96a2-b12e0ff70337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c78b3db906437cbac569ba4a352771'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:25:34.073559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8f9f08bd-6d18-4143-96a2-b12e0ff70337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c78b3db906437cbac569ba4a352771'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:25:34.074415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8f9f08bd-6d18-4143-96a2-b12e0ff70337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c78b3db906437cbac569ba4a352771'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:25:34.081489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8f9f08bd-6d18-4143-96a2-b12e0ff70337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c78b3db906437cbac569ba4a352771'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:25:34.088996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8f9f08bd-6d18-4143-96a2-b12e0ff70337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c78b3db906437cbac569ba4a352771'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:25:34.107026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1150/2309] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:25:33 2022] DELETE /identity/v3/users/74c78b3db906437cbac569ba4a352771 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:25:34.293943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8cbb8-d291-400b-a5d6-5f6aafd08404 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:25:34.304397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8cbb8-d291-400b-a5d6-5f6aafd08404 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:25:34.370419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:25:34.371084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:34.371415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:34.371690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] PATH_INFO: `/v3/projects/38a776c6780e40098f4c3171b157f77a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:34.372948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a776c6780e40098f4c3171b157f77a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:25:34.374902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:25:34.421238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a776c6780e40098f4c3171b157f77a', 'request_id': 'req-537e94ef-d356-4bd4-a9c4-6ba69163de77'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:25:34.425787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:34.427775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a776c6780e40098f4c3171b157f77a', 'request_id': 'req-537e94ef-d356-4bd4-a9c4-6ba69163de77'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:25:34.436223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a776c6780e40098f4c3171b157f77a', 'request_id': 'req-537e94ef-d356-4bd4-a9c4-6ba69163de77'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:25:34.448697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] The token cache is being invalidate because project 38a776c6780e40098f4c3171b157f77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:25:34.449081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:25:34.449718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-537e94ef-d356-4bd4-a9c4-6ba69163de77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:25:34.451187 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1160/2310] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:25:34 2022] DELETE /identity/v3/projects/38a776c6780e40098f4c3171b157f77a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:25:44.103438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:44.445684 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=5,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:25:52.471877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0f18-7288-4e29-92fe-2381b46f644f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:52.472658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0f18-7288-4e29-92fe-2381b46f644f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:52.472658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac0f18-7288-4e29-92fe-2381b46f644f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:52.496766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-efac0f18-7288-4e29-92fe-2381b46f644f None None] MFA Rules not processed for user `d86b39b1bf7546dea03dbf180ab567e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:25:52.497957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-efac0f18-7288-4e29-92fe-2381b46f644f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:52.563456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1151/2311] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:25:59.461180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507c858-1438-491b-ab33-f29c64047d7c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:25:59.461180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507c858-1438-491b-ab33-f29c64047d7c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:25:59.461870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7507c858-1438-491b-ab33-f29c64047d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:25:59.481425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7507c858-1438-491b-ab33-f29c64047d7c None None] MFA Rules not processed for user `336b111f4b854a21ad3d9fe8fcff6f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:25:59.482888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7507c858-1438-491b-ab33-f29c64047d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:25:59.574871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1161/2312] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:25:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:26:00.470949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fbab6-224f-47c7-9969-65489509063d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:00.471463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fbab6-224f-47c7-9969-65489509063d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:00.471570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fbab6-224f-47c7-9969-65489509063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:00.493166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-403fbab6-224f-47c7-9969-65489509063d None None] MFA Rules not processed for user `c2c4ba36ac1240e0bbca86690a69b64c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:26:00.494403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-403fbab6-224f-47c7-9969-65489509063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:26:00.551883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1152/2313] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:26:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:26:09.538356 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=25 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:10.544108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=50 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:14.160488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03250fec-d731-40f3-8f03-03448a251a31 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:14.162544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03250fec-d731-40f3-8f03-03448a251a31 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:14.163109 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03250fec-d731-40f3-8f03-03448a251a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:14.193523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-03250fec-d731-40f3-8f03-03448a251a31 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:26:14.194834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-03250fec-d731-40f3-8f03-03448a251a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:26:14.271653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1162/2314] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 19 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:26:14.295962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fbab6-224f-47c7-9969-65489509063d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:26:14.297476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-403fbab6-224f-47c7-9969-65489509063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:26:14.382474 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fbab6-224f-47c7-9969-65489509063d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:26:14.388085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11b497-6a39-48d1-8025-04ae64f918d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:26:14.388769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b497-6a39-48d1-8025-04ae64f918d2 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:14.389158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b497-6a39-48d1-8025-04ae64f918d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:14.389438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b497-6a39-48d1-8025-04ae64f918d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:14.399539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11b497-6a39-48d1-8025-04ae64f918d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:26:14.401195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11b497-6a39-48d1-8025-04ae64f918d2 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:26:14.412528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1153/2315] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:26:16.061492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a895a1-055c-437c-819c-eb85562fd420 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:16.061981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a895a1-055c-437c-819c-eb85562fd420 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:16.062721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a895a1-055c-437c-819c-eb85562fd420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:16.088457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-11a895a1-055c-437c-819c-eb85562fd420 None None] MFA Rules not processed for user `957c3a73b4f14927905fde65c9c844cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:26:16.089708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-11a895a1-055c-437c-819c-eb85562fd420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:26:16.146004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1163/2316] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:26:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:26:17.437954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70879946-b552-451c-9548-67bf043cc707 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:17.438531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70879946-b552-451c-9548-67bf043cc707 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:17.438531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70879946-b552-451c-9548-67bf043cc707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:17.458252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-70879946-b552-451c-9548-67bf043cc707 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:26:17.459448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-70879946-b552-451c-9548-67bf043cc707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:26:17.467166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1154/2317] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 19 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:26:17.492889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a895a1-055c-437c-819c-eb85562fd420 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:26:17.494903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-11a895a1-055c-437c-819c-eb85562fd420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:26:17.510613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a895a1-055c-437c-819c-eb85562fd420 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:26:17.515987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ddf50-3536-4899-acde-2bff3955efbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:26:17.516584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ddf50-3536-4899-acde-2bff3955efbe service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:17.516865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ddf50-3536-4899-acde-2bff3955efbe service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:17.517137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ddf50-3536-4899-acde-2bff3955efbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:17.525830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ddf50-3536-4899-acde-2bff3955efbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:26:17.527444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ddf50-3536-4899-acde-2bff3955efbe service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:26:17.538566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1164/2318] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:26:21.554723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5709147-82bc-4a6a-b390-09e48a36b718 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:21.555252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5709147-82bc-4a6a-b390-09e48a36b718 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:21.555252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5709147-82bc-4a6a-b390-09e48a36b718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:21.576012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f5709147-82bc-4a6a-b390-09e48a36b718 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:26:21.577299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f5709147-82bc-4a6a-b390-09e48a36b718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:26:21.586272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1155/2319] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 19 15:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:26:21.618188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ddf50-3536-4899-acde-2bff3955efbe service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:26:21.631013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ddf50-3536-4899-acde-2bff3955efbe service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:26:21.636729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cc09b-7363-4641-b318-d33bc3269628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:26:21.637432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cc09b-7363-4641-b318-d33bc3269628 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:21.637795 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cc09b-7363-4641-b318-d33bc3269628 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:21.638178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cc09b-7363-4641-b318-d33bc3269628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:21.648804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cc09b-7363-4641-b318-d33bc3269628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:26:21.650431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cc09b-7363-4641-b318-d33bc3269628 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:26:21.660108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1165/2320] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:26:24.732594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dd731-3a8c-4cfc-a439-effc3f2ec33f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:24.733133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dd731-3a8c-4cfc-a439-effc3f2ec33f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:24.733133 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dd731-3a8c-4cfc-a439-effc3f2ec33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:24.752183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-013dd731-3a8c-4cfc-a439-effc3f2ec33f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:26:24.753386 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-013dd731-3a8c-4cfc-a439-effc3f2ec33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:26:24.761719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1156/2321] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 19 15:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:26:24.783485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cc09b-7363-4641-b318-d33bc3269628 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:26:24.795146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cc09b-7363-4641-b318-d33bc3269628 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:26:24.800722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf15831-cc72-420b-a8e5-86412a769277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:26:24.801319 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf15831-cc72-420b-a8e5-86412a769277 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:24.801595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf15831-cc72-420b-a8e5-86412a769277 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:24.801865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf15831-cc72-420b-a8e5-86412a769277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:24.810288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf15831-cc72-420b-a8e5-86412a769277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:26:24.812264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf15831-cc72-420b-a8e5-86412a769277 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:26:24.829169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1166/2322] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:26:28.921306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526006a-db15-4a0f-8694-d63b75824199 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:28.921843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526006a-db15-4a0f-8694-d63b75824199 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:28.921843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526006a-db15-4a0f-8694-d63b75824199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:28.940561 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e526006a-db15-4a0f-8694-d63b75824199 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:26:28.941752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e526006a-db15-4a0f-8694-d63b75824199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:26:28.949588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1157/2323] 10.222.0.73 () {58 vars in 1016 bytes} [Fri Aug 19 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:26:28.978623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf15831-cc72-420b-a8e5-86412a769277 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:26:28.989620 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf15831-cc72-420b-a8e5-86412a769277 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:26:28.995053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3e1ae-24fd-4d1e-b5c7-531905664c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:26:28.995640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3e1ae-24fd-4d1e-b5c7-531905664c36 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:28.995945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3e1ae-24fd-4d1e-b5c7-531905664c36 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:28.996218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3e1ae-24fd-4d1e-b5c7-531905664c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:29.004675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3e1ae-24fd-4d1e-b5c7-531905664c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:26:29.006259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3e1ae-24fd-4d1e-b5c7-531905664c36 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:26:29.015410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1167/2324] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:26:38.935867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=46 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:39.011329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=76 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:26:47.539440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3ede5-e4ad-46a2-910e-6116fb4871eb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:26:47.540017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3ede5-e4ad-46a2-910e-6116fb4871eb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:26:47.540127 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3ede5-e4ad-46a2-910e-6116fb4871eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:26:47.568070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-42d3ede5-e4ad-46a2-910e-6116fb4871eb None None] MFA Rules not processed for user `a684c639db1f44488d1b05ee55014c71`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:26:47.569344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-42d3ede5-e4ad-46a2-910e-6116fb4871eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:26:47.640528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1158/2325] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:26:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:26:57.634431 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=25 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:02.955564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e7e9-a797-4e5a-95cb-4d016aa57ab5 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:02.956088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e7e9-a797-4e5a-95cb-4d016aa57ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:02.956184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653e7e9-a797-4e5a-95cb-4d016aa57ab5 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:02.957566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1168/2326] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:27:02.977397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a890374-8d81-4089-b922-80dc008d82cd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:02.977858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a890374-8d81-4089-b922-80dc008d82cd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:02.978015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a890374-8d81-4089-b922-80dc008d82cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:02.998515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4a890374-8d81-4089-b922-80dc008d82cd None None] MFA Rules not processed for user `2862a661174142d69bbdd54ee0289681`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:02.999711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4a890374-8d81-4089-b922-80dc008d82cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:03.050457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653e7e9-a797-4e5a-95cb-4d016aa57ab5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:03.057139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8653e7e9-a797-4e5a-95cb-4d016aa57ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:03.076194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653e7e9-a797-4e5a-95cb-4d016aa57ab5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:03.081552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:03.082310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:03.082848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:03.083208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] PATH_INFO: `/v3/users/d86b39b1bf7546dea03dbf180ab567e2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:03.084735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86b39b1bf7546dea03dbf180ab567e2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:03.086783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:03.099427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1159/2327] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:27:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:03.107637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a890374-8d81-4089-b922-80dc008d82cd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:03.109446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4a890374-8d81-4089-b922-80dc008d82cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:03.124022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a890374-8d81-4089-b922-80dc008d82cd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:03.130230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c1adb-05f6-4541-b221-866916dc3671 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2862a661174142d69bbdd54ee0289681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:03.130949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c1adb-05f6-4541-b221-866916dc3671 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:03.131393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c1adb-05f6-4541-b221-866916dc3671 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:03.131950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c1adb-05f6-4541-b221-866916dc3671 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:03.142155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c1adb-05f6-4541-b221-866916dc3671 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:03.143854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c1adb-05f6-4541-b221-866916dc3671 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:03.147574 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86b39b1bf7546dea03dbf180ab567e2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:03.155983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1160/2328] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:27:03.157800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86b39b1bf7546dea03dbf180ab567e2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:03.180243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86b39b1bf7546dea03dbf180ab567e2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:03.193075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86b39b1bf7546dea03dbf180ab567e2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:03.193778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86b39b1bf7546dea03dbf180ab567e2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:03.203594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1169/2329] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:27:03 2022] DELETE /identity/v3/users/d86b39b1bf7546dea03dbf180ab567e2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:27:03.614271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c1adb-05f6-4541-b221-866916dc3671 service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:03.626132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c1adb-05f6-4541-b221-866916dc3671 service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:03.681601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:03.682259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:03.682545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:03.682819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] PATH_INFO: `/v3/projects/fedce057119142068b9f92e07454b9fa` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:03.683931 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedce057119142068b9f92e07454b9fa)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:03.685829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:03.734037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedce057119142068b9f92e07454b9fa', 'request_id': 'req-7f0d2335-f576-45a4-871a-1e68adb433e6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:03.739450 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedce057119142068b9f92e07454b9fa', 'request_id': 'req-7f0d2335-f576-45a4-871a-1e68adb433e6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:03.747402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedce057119142068b9f92e07454b9fa', 'request_id': 'req-7f0d2335-f576-45a4-871a-1e68adb433e6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:03.758922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] The token cache is being invalidate because project fedce057119142068b9f92e07454b9fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:27:03.759214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:03.759844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:03.761319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1161/2330] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:27:03 2022] DELETE /identity/v3/projects/fedce057119142068b9f92e07454b9fa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:03.989017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:03.990531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:04.046458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017785d-8f2a-4b05-a737-5e20d276455c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:04.092293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5bdf5b-c311-4ac9-9af1-08d9c816ca06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:04.092894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bdf5b-c311-4ac9-9af1-08d9c816ca06 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:04.093175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bdf5b-c311-4ac9-9af1-08d9c816ca06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:04.093450 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bdf5b-c311-4ac9-9af1-08d9c816ca06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:04.095185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3a5bdf5b-c311-4ac9-9af1-08d9c816ca06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:04.136359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:04.166716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5bdf5b-c311-4ac9-9af1-08d9c816ca06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:04.168150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5bdf5b-c311-4ac9-9af1-08d9c816ca06 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:04.179253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1170/2331] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:05.464195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:05.465656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:05.478233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d2335-f576-45a4-871a-1e68adb433e6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:05.481933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c451a-de65-4d63-9074-e21a2c82aafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:05.482567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c451a-de65-4d63-9074-e21a2c82aafb service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:05.482844 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c451a-de65-4d63-9074-e21a2c82aafb service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:05.483114 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c451a-de65-4d63-9074-e21a2c82aafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:05.484877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-332c451a-de65-4d63-9074-e21a2c82aafb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:05.498840 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c451a-de65-4d63-9074-e21a2c82aafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:05.500266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c451a-de65-4d63-9074-e21a2c82aafb service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:05.506114 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:05.512792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1162/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:12.548459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5bdf5b-c311-4ac9-9af1-08d9c816ca06 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:12.563656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5bdf5b-c311-4ac9-9af1-08d9c816ca06 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:12.567497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0b75c-aaa2-4065-8c85-a9468f9560f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:12.568107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0b75c-aaa2-4065-8c85-a9468f9560f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:12.568393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0b75c-aaa2-4065-8c85-a9468f9560f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:12.568668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0b75c-aaa2-4065-8c85-a9468f9560f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:12.570486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-33a0b75c-aaa2-4065-8c85-a9468f9560f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:12.636359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0b75c-aaa2-4065-8c85-a9468f9560f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:12.637795 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0b75c-aaa2-4065-8c85-a9468f9560f6 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:12.647408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1171/2333] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:16.100934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c451a-de65-4d63-9074-e21a2c82aafb service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:16.105019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-332c451a-de65-4d63-9074-e21a2c82aafb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:16.135539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c451a-de65-4d63-9074-e21a2c82aafb service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:16.143207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de79b33-9f51-4c3f-aa7b-1099bea2179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:16.144694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79b33-9f51-4c3f-aa7b-1099bea2179e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:16.145438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79b33-9f51-4c3f-aa7b-1099bea2179e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:16.146021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de79b33-9f51-4c3f-aa7b-1099bea2179e admin admin] PATH_INFO: `/v3/users/336b111f4b854a21ad3d9fe8fcff6f8b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:16.147728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de79b33-9f51-4c3f-aa7b-1099bea2179e admin admin] RBAC: Authorizing `identity:delete_user(user_id=336b111f4b854a21ad3d9fe8fcff6f8b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:16.150198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de79b33-9f51-4c3f-aa7b-1099bea2179e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:16.246533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2de79b33-9f51-4c3f-aa7b-1099bea2179e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336b111f4b854a21ad3d9fe8fcff6f8b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:16.247326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2de79b33-9f51-4c3f-aa7b-1099bea2179e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336b111f4b854a21ad3d9fe8fcff6f8b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:16.248183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2de79b33-9f51-4c3f-aa7b-1099bea2179e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336b111f4b854a21ad3d9fe8fcff6f8b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:16.261440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2de79b33-9f51-4c3f-aa7b-1099bea2179e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336b111f4b854a21ad3d9fe8fcff6f8b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:16.270349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-2de79b33-9f51-4c3f-aa7b-1099bea2179e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336b111f4b854a21ad3d9fe8fcff6f8b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:16.294192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1163/2334] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:27:16 2022] DELETE /identity/v3/users/336b111f4b854a21ad3d9fe8fcff6f8b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:16.472478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0b75c-aaa2-4065-8c85-a9468f9560f6 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:16.483307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0b75c-aaa2-4065-8c85-a9468f9560f6 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:16.545533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:16.546202 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:16.546477 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:16.546829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] PATH_INFO: `/v3/projects/f38bebb8f23b401b8205010647b7cdc5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:16.547888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38bebb8f23b401b8205010647b7cdc5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:16.549862 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:16.605593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38bebb8f23b401b8205010647b7cdc5', 'request_id': 'req-39210cb7-9018-4722-bd3b-b3c796dc4c4c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:16.611256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38bebb8f23b401b8205010647b7cdc5', 'request_id': 'req-39210cb7-9018-4722-bd3b-b3c796dc4c4c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:16.618754 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38bebb8f23b401b8205010647b7cdc5', 'request_id': 'req-39210cb7-9018-4722-bd3b-b3c796dc4c4c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:16.620330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:16.635149 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] The token cache is being invalidate because project f38bebb8f23b401b8205010647b7cdc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:27:16.635490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:16.636156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39210cb7-9018-4722-bd3b-b3c796dc4c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:16.637994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1172/2335] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:27:16 2022] DELETE /identity/v3/projects/f38bebb8f23b401b8205010647b7cdc5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:16.642678 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd384a-91a9-4ad6-a4ab-5d02109a368f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:16.642973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd384a-91a9-4ad6-a4ab-5d02109a368f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:16.643254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd384a-91a9-4ad6-a4ab-5d02109a368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:16.666950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-1dcd384a-91a9-4ad6-a4ab-5d02109a368f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:16.668160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1dcd384a-91a9-4ad6-a4ab-5d02109a368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:16.748760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1164/2336] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:16.750724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1c19-a9fd-4a72-bd4b-306946ccca67 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:16.751012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1c19-a9fd-4a72-bd4b-306946ccca67 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:16.751284 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1c19-a9fd-4a72-bd4b-306946ccca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:16.772573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-c25f1c19-a9fd-4a72-bd4b-306946ccca67 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:16.774367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c25f1c19-a9fd-4a72-bd4b-306946ccca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:16.785950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1173/2337] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:16.790368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd384a-91a9-4ad6-a4ab-5d02109a368f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:16.803252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd384a-91a9-4ad6-a4ab-5d02109a368f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:16.808262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6762875-692e-4693-840b-33e438c05cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:16.808876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6762875-692e-4693-840b-33e438c05cfa admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:16.809355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6762875-692e-4693-840b-33e438c05cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:16.809630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6762875-692e-4693-840b-33e438c05cfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:16.810489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6762875-692e-4693-840b-33e438c05cfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:27:16.810968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6762875-692e-4693-840b-33e438c05cfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:16.812946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6762875-692e-4693-840b-33e438c05cfa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:16.841027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1165/2338] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:27:16.845285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f1c19-a9fd-4a72-bd4b-306946ccca67 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:16.859288 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f1c19-a9fd-4a72-bd4b-306946ccca67 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:16.865089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60712696-d059-4642-953d-da17d52110db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:16.865899 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60712696-d059-4642-953d-da17d52110db admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:16.866327 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60712696-d059-4642-953d-da17d52110db admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:16.866764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60712696-d059-4642-953d-da17d52110db admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:16.867469 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60712696-d059-4642-953d-da17d52110db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:16.869527 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60712696-d059-4642-953d-da17d52110db admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:16.904177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1174/2339] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:27:16 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:27:16.905332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6762875-692e-4693-840b-33e438c05cfa admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:16.917142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6762875-692e-4693-840b-33e438c05cfa admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:17.004570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95d46b-9eb9-494c-9bf7-a0a6c1eae249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:17.005233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95d46b-9eb9-494c-9bf7-a0a6c1eae249 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.005521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95d46b-9eb9-494c-9bf7-a0a6c1eae249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.005797 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95d46b-9eb9-494c-9bf7-a0a6c1eae249 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.006526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95d46b-9eb9-494c-9bf7-a0a6c1eae249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:17.009070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95d46b-9eb9-494c-9bf7-a0a6c1eae249 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:17.018357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:17.045304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1166/2340] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:27:16 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:27:17.049371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60712696-d059-4642-953d-da17d52110db admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:17.081203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60712696-d059-4642-953d-da17d52110db admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:17.088990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabbefa-9b32-414c-ba58-d45196299e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:17.089686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbefa-9b32-414c-ba58-d45196299e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.090110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbefa-9b32-414c-ba58-d45196299e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.090572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabbefa-9b32-414c-ba58-d45196299e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.091294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabbefa-9b32-414c-ba58-d45196299e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:17.093049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfabbefa-9b32-414c-ba58-d45196299e03 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:17.104563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1175/2341] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:17.108741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95d46b-9eb9-494c-9bf7-a0a6c1eae249 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:17.121166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95d46b-9eb9-494c-9bf7-a0a6c1eae249 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:17.132242 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac42cf-f930-43c9-85d9-13516a088869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:17.133547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac42cf-f930-43c9-85d9-13516a088869 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.133830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac42cf-f930-43c9-85d9-13516a088869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.134323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac42cf-f930-43c9-85d9-13516a088869 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.134991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac42cf-f930-43c9-85d9-13516a088869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:17.136629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac42cf-f930-43c9-85d9-13516a088869 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:17.148136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1167/2342] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:27:17.153215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabbefa-9b32-414c-ba58-d45196299e03 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:17.163448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabbefa-9b32-414c-ba58-d45196299e03 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:17.168388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47734b95-39e1-4039-b7d8-4c1034134591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:17.168998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47734b95-39e1-4039-b7d8-4c1034134591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.169280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47734b95-39e1-4039-b7d8-4c1034134591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.169559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47734b95-39e1-4039-b7d8-4c1034134591 admin admin] PATH_INFO: `/v3/projects/2cccd82a33b54b88b81388af39cd3f2d/users/8532a2affb8e4a68b73c9c905652dae0/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.186809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47734b95-39e1-4039-b7d8-4c1034134591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cccd82a33b54b88b81388af39cd3f2d, user_id=8532a2affb8e4a68b73c9c905652dae0, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:17.189573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47734b95-39e1-4039-b7d8-4c1034134591 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:17.217114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1176/2343] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:27:17 2022] PUT /identity/v3/projects/2cccd82a33b54b88b81388af39cd3f2d/users/8532a2affb8e4a68b73c9c905652dae0/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:17.220433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493de23d-b431-4c10-9775-63fa9f9328bb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.220786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493de23d-b431-4c10-9775-63fa9f9328bb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.221081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493de23d-b431-4c10-9775-63fa9f9328bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.254999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-493de23d-b431-4c10-9775-63fa9f9328bb None None] MFA Rules not processed for user `8532a2affb8e4a68b73c9c905652dae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:17.256417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-493de23d-b431-4c10-9775-63fa9f9328bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:17.332208 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1168/2344] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:17.336458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47734b95-39e1-4039-b7d8-4c1034134591 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:17.414924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47734b95-39e1-4039-b7d8-4c1034134591 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:17.420028 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4de5-9e9a-43ad-8c3d-c79de1d7ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:17.420747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4de5-9e9a-43ad-8c3d-c79de1d7ecf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.421094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4de5-9e9a-43ad-8c3d-c79de1d7ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.421412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c4de5-9e9a-43ad-8c3d-c79de1d7ecf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.422773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c4de5-9e9a-43ad-8c3d-c79de1d7ecf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:17.425127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c4de5-9e9a-43ad-8c3d-c79de1d7ecf9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:17.458878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1177/2345] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:27:17 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:27:17.463223 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493de23d-b431-4c10-9775-63fa9f9328bb None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:17.475668 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493de23d-b431-4c10-9775-63fa9f9328bb None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:17.544685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44881d79-4dc4-4221-8a30-406b051362f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:17.545296 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44881d79-4dc4-4221-8a30-406b051362f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.545576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44881d79-4dc4-4221-8a30-406b051362f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.546089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44881d79-4dc4-4221-8a30-406b051362f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.546724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44881d79-4dc4-4221-8a30-406b051362f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:17.548674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44881d79-4dc4-4221-8a30-406b051362f4 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:17.577696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1169/2346] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:27:17 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:27:17.579387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4de5-9e9a-43ad-8c3d-c79de1d7ecf9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:17.590221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c4de5-9e9a-43ad-8c3d-c79de1d7ecf9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:17.595197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22535916-c284-49c7-aac8-67144cf9ebd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:17.595872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22535916-c284-49c7-aac8-67144cf9ebd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.596222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22535916-c284-49c7-aac8-67144cf9ebd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.596583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22535916-c284-49c7-aac8-67144cf9ebd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.597539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22535916-c284-49c7-aac8-67144cf9ebd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:17.599223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22535916-c284-49c7-aac8-67144cf9ebd8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:17.613113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1178/2347] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:17.614405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44881d79-4dc4-4221-8a30-406b051362f4 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:17.625029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44881d79-4dc4-4221-8a30-406b051362f4 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:17.629782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e802436-e1c7-449a-8c8b-69a928447aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:17.630575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e802436-e1c7-449a-8c8b-69a928447aee admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.630863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e802436-e1c7-449a-8c8b-69a928447aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.631132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e802436-e1c7-449a-8c8b-69a928447aee admin admin] PATH_INFO: `/v3/projects/a4fc1e8b9c39410eb8b37eb865bab80c/users/ebd905426ba74d27a82456ec1d4fdafe/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.648651 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e802436-e1c7-449a-8c8b-69a928447aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fc1e8b9c39410eb8b37eb865bab80c, user_id=ebd905426ba74d27a82456ec1d4fdafe, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:17.651543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e802436-e1c7-449a-8c8b-69a928447aee admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:17.666515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1170/2348] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:27:17 2022] PUT /identity/v3/projects/a4fc1e8b9c39410eb8b37eb865bab80c/users/ebd905426ba74d27a82456ec1d4fdafe/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:17.670451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22535916-c284-49c7-aac8-67144cf9ebd8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:17.681256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22535916-c284-49c7-aac8-67144cf9ebd8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:17.738729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431f0d6-35f9-4dbf-8fb5-0b14a3de7f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:17.739736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431f0d6-35f9-4dbf-8fb5-0b14a3de7f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.740024 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431f0d6-35f9-4dbf-8fb5-0b14a3de7f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.740437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431f0d6-35f9-4dbf-8fb5-0b14a3de7f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.741218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431f0d6-35f9-4dbf-8fb5-0b14a3de7f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:17.743753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431f0d6-35f9-4dbf-8fb5-0b14a3de7f99 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:17.749692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:17.755456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1179/2349] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:17.759718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e802436-e1c7-449a-8c8b-69a928447aee admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:17.771269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e802436-e1c7-449a-8c8b-69a928447aee admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:17.776401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986abbc4-f0ff-4dd5-937f-7c5bad1b94f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:17.777276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986abbc4-f0ff-4dd5-937f-7c5bad1b94f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.777764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986abbc4-f0ff-4dd5-937f-7c5bad1b94f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.778179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986abbc4-f0ff-4dd5-937f-7c5bad1b94f7 admin admin] PATH_INFO: `/v3/projects/a4fc1e8b9c39410eb8b37eb865bab80c/users/ebd905426ba74d27a82456ec1d4fdafe/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.781651 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986abbc4-f0ff-4dd5-937f-7c5bad1b94f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fc1e8b9c39410eb8b37eb865bab80c, user_id=ebd905426ba74d27a82456ec1d4fdafe, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:17.785094 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986abbc4-f0ff-4dd5-937f-7c5bad1b94f7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:17.797064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1171/2350] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:27:17 2022] PUT /identity/v3/projects/a4fc1e8b9c39410eb8b37eb865bab80c/users/ebd905426ba74d27a82456ec1d4fdafe/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:17.809457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c23570-df81-43e4-95e7-61697d3308cc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:17.810074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c23570-df81-43e4-95e7-61697d3308cc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:17.810424 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c23570-df81-43e4-95e7-61697d3308cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:17.839915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e0c23570-df81-43e4-95e7-61697d3308cc None None] MFA Rules not processed for user `ebd905426ba74d27a82456ec1d4fdafe`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:17.841131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e0c23570-df81-43e4-95e7-61697d3308cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:17.918663 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1180/2351] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:17.930952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986abbc4-f0ff-4dd5-937f-7c5bad1b94f7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:17.932944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-986abbc4-f0ff-4dd5-937f-7c5bad1b94f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:17.955978 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:17.995349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986abbc4-f0ff-4dd5-937f-7c5bad1b94f7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:17.999892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd889541-ab47-4cc1-ab0b-811af4376803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:18.000624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889541-ab47-4cc1-ab0b-811af4376803 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:18.000944 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889541-ab47-4cc1-ab0b-811af4376803 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:18.001288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889541-ab47-4cc1-ab0b-811af4376803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:18.013083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd889541-ab47-4cc1-ab0b-811af4376803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:18.014568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd889541-ab47-4cc1-ab0b-811af4376803 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:18.025565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1172/2352] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:18.113632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c23570-df81-43e4-95e7-61697d3308cc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:18.123272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c23570-df81-43e4-95e7-61697d3308cc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:18.126904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41f41f-863b-41aa-9705-61ca5d64a9eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:18.127510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41f41f-863b-41aa-9705-61ca5d64a9eb service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:18.127817 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41f41f-863b-41aa-9705-61ca5d64a9eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:18.128060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41f41f-863b-41aa-9705-61ca5d64a9eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:18.187004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41f41f-863b-41aa-9705-61ca5d64a9eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:18.188414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41f41f-863b-41aa-9705-61ca5d64a9eb service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:18.197735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1181/2353] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:18.905130 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b39f16-8701-4e08-a9ca-13e9338932b8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:18.905605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b39f16-8701-4e08-a9ca-13e9338932b8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:18.905722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b39f16-8701-4e08-a9ca-13e9338932b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:18.925554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-48b39f16-8701-4e08-a9ca-13e9338932b8 None None] MFA Rules not processed for user `c2c4ba36ac1240e0bbca86690a69b64c`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:18.926822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-48b39f16-8701-4e08-a9ca-13e9338932b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:18.983227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1173/2354] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:19.283276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41f41f-863b-41aa-9705-61ca5d64a9eb service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:19.284815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7f41f41f-863b-41aa-9705-61ca5d64a9eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:19.343003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41f41f-863b-41aa-9705-61ca5d64a9eb service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:19.346535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beee858-0981-40fb-9a5a-8b9ba78567b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:19.347389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beee858-0981-40fb-9a5a-8b9ba78567b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:19.347665 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beee858-0981-40fb-9a5a-8b9ba78567b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:19.347934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beee858-0981-40fb-9a5a-8b9ba78567b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:19.349731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3beee858-0981-40fb-9a5a-8b9ba78567b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:19.359458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beee858-0981-40fb-9a5a-8b9ba78567b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:19.360895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beee858-0981-40fb-9a5a-8b9ba78567b5 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:19.369060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1182/2355] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:19.712932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b39f16-8701-4e08-a9ca-13e9338932b8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:19.714554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-48b39f16-8701-4e08-a9ca-13e9338932b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:19.792667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b39f16-8701-4e08-a9ca-13e9338932b8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:19.798284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003e0c8-3193-466f-b842-f84d3029d538 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2862a661174142d69bbdd54ee0289681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:19.800419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003e0c8-3193-466f-b842-f84d3029d538 service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:19.800707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003e0c8-3193-466f-b842-f84d3029d538 service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:19.800977 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003e0c8-3193-466f-b842-f84d3029d538 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:19.802757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0003e0c8-3193-466f-b842-f84d3029d538 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:19.816008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003e0c8-3193-466f-b842-f84d3029d538 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:19.817883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0003e0c8-3193-466f-b842-f84d3029d538 service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:19.829752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1174/2356] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:21.794143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beee858-0981-40fb-9a5a-8b9ba78567b5 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:21.794143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3beee858-0981-40fb-9a5a-8b9ba78567b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:21.832779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:21.880704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beee858-0981-40fb-9a5a-8b9ba78567b5 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:21.887407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e82c9d-67a7-4c71-b103-2fa51df0899a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:21.888089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82c9d-67a7-4c71-b103-2fa51df0899a service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:21.888371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82c9d-67a7-4c71-b103-2fa51df0899a service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:21.888645 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e82c9d-67a7-4c71-b103-2fa51df0899a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:21.890541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b5e82c9d-67a7-4c71-b103-2fa51df0899a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:21.960451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e82c9d-67a7-4c71-b103-2fa51df0899a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:21.963941 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e82c9d-67a7-4c71-b103-2fa51df0899a service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:21.976593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1183/2357] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:23.033087 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003e0c8-3193-466f-b842-f84d3029d538 service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:23.109218 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:23.113933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0003e0c8-3193-466f-b842-f84d3029d538 service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:23.119582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:23.120357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:23.120895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:23.121106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] PATH_INFO: `/v3/users/8532a2affb8e4a68b73c9c905652dae0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:23.122756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8532a2affb8e4a68b73c9c905652dae0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:23.124419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:23.188481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8532a2affb8e4a68b73c9c905652dae0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.189163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8532a2affb8e4a68b73c9c905652dae0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.189770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8532a2affb8e4a68b73c9c905652dae0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.198188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8532a2affb8e4a68b73c9c905652dae0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.206187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8532a2affb8e4a68b73c9c905652dae0'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.230112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1175/2358] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:27:23 2022] DELETE /identity/v3/users/8532a2affb8e4a68b73c9c905652dae0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:23.231313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f891c-740d-4d6a-af6f-cd54708b2e34 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:23.231779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f891c-740d-4d6a-af6f-cd54708b2e34 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:23.231876 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f891c-740d-4d6a-af6f-cd54708b2e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:23.251006 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-fa3f891c-740d-4d6a-af6f-cd54708b2e34 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:23.252221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fa3f891c-740d-4d6a-af6f-cd54708b2e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:23.313363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1184/2359] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:27:23.323830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:23.325287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:23.382801 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714f33c-24cf-4e5f-b7b6-b147a474727a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:23.387055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81befa5a-8abd-472d-ace4-07a239546097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:23.387655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81befa5a-8abd-472d-ace4-07a239546097 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:23.387937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81befa5a-8abd-472d-ace4-07a239546097 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:23.388215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81befa5a-8abd-472d-ace4-07a239546097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:23.397115 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81befa5a-8abd-472d-ace4-07a239546097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:23.398594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81befa5a-8abd-472d-ace4-07a239546097 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:23.408297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1176/2360] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:23.684008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f891c-740d-4d6a-af6f-cd54708b2e34 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:23.685440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fa3f891c-740d-4d6a-af6f-cd54708b2e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:23.697314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f891c-740d-4d6a-af6f-cd54708b2e34 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:23.702230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:23.702864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:23.703145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:23.703418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] PATH_INFO: `/v3/projects/2cccd82a33b54b88b81388af39cd3f2d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:23.704526 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cccd82a33b54b88b81388af39cd3f2d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:23.706470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:23.753614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cccd82a33b54b88b81388af39cd3f2d', 'request_id': 'req-0d798ad9-bf11-459e-88b7-802f4032d4f0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.759759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cccd82a33b54b88b81388af39cd3f2d', 'request_id': 'req-0d798ad9-bf11-459e-88b7-802f4032d4f0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.761314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:23.767641 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cccd82a33b54b88b81388af39cd3f2d', 'request_id': 'req-0d798ad9-bf11-459e-88b7-802f4032d4f0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.779048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] The token cache is being invalidate because project 2cccd82a33b54b88b81388af39cd3f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:27:23.779337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.779954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.781419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1185/2361] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:27:23 2022] DELETE /identity/v3/projects/2cccd82a33b54b88b81388af39cd3f2d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:23.785404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81befa5a-8abd-472d-ace4-07a239546097 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:23.795379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81befa5a-8abd-472d-ace4-07a239546097 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:23.852231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c6678-1564-4c83-84a0-ea17e0ed0f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:23.852853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c6678-1564-4c83-84a0-ea17e0ed0f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:23.853132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c6678-1564-4c83-84a0-ea17e0ed0f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:23.853401 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c6678-1564-4c83-84a0-ea17e0ed0f35 admin admin] PATH_INFO: `/v3/users/ebd905426ba74d27a82456ec1d4fdafe` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:23.854533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c6678-1564-4c83-84a0-ea17e0ed0f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd905426ba74d27a82456ec1d4fdafe)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:23.856441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c6678-1564-4c83-84a0-ea17e0ed0f35 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:23.877899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:23.901666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-623c6678-1564-4c83-84a0-ea17e0ed0f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd905426ba74d27a82456ec1d4fdafe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.902319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-623c6678-1564-4c83-84a0-ea17e0ed0f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd905426ba74d27a82456ec1d4fdafe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.902913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-623c6678-1564-4c83-84a0-ea17e0ed0f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd905426ba74d27a82456ec1d4fdafe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.909782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-623c6678-1564-4c83-84a0-ea17e0ed0f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd905426ba74d27a82456ec1d4fdafe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.917249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-623c6678-1564-4c83-84a0-ea17e0ed0f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd905426ba74d27a82456ec1d4fdafe'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:23.934815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1177/2362] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:27:23 2022] DELETE /identity/v3/users/ebd905426ba74d27a82456ec1d4fdafe => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:24.206745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:24.210188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:24.234870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798ad9-bf11-459e-88b7-802f4032d4f0 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:24.304441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:24.305124 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:24.305405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:24.305841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] PATH_INFO: `/v3/projects/a4fc1e8b9c39410eb8b37eb865bab80c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:24.307025 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4fc1e8b9c39410eb8b37eb865bab80c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:24.309303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:24.383793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4fc1e8b9c39410eb8b37eb865bab80c', 'request_id': 'req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:24.391229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4fc1e8b9c39410eb8b37eb865bab80c', 'request_id': 'req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:24.404572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4fc1e8b9c39410eb8b37eb865bab80c', 'request_id': 'req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:24.420612 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] The token cache is being invalidate because project a4fc1e8b9c39410eb8b37eb865bab80c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:27:24.420901 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:24.430201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2cb4a1d2-fcfb-4cd8-9fba-2cce1ebc7701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:24.432578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1186/2363] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:27:24 2022] DELETE /identity/v3/projects/a4fc1e8b9c39410eb8b37eb865bab80c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:24.439126 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017076-71a5-40dc-995a-23d20c0c4fb4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:24.440916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017076-71a5-40dc-995a-23d20c0c4fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:24.441445 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a017076-71a5-40dc-995a-23d20c0c4fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:24.467008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7a017076-71a5-40dc-995a-23d20c0c4fb4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:24.468279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7a017076-71a5-40dc-995a-23d20c0c4fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:24.561106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1178/2364] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:27:24.569883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c64f31-ba2b-406a-bc43-20be5f011c4c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:24.570976 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c64f31-ba2b-406a-bc43-20be5f011c4c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:24.571623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c64f31-ba2b-406a-bc43-20be5f011c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:24.594054 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-68c64f31-ba2b-406a-bc43-20be5f011c4c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:24.595344 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-68c64f31-ba2b-406a-bc43-20be5f011c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:24.607607 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1187/2365] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:24.608784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a017076-71a5-40dc-995a-23d20c0c4fb4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:24.618785 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a017076-71a5-40dc-995a-23d20c0c4fb4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:24.626079 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075f901-3cb7-4044-bc2c-f098c93f543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:24.626707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f901-3cb7-4044-bc2c-f098c93f543e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:24.626985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f901-3cb7-4044-bc2c-f098c93f543e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:24.627250 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f901-3cb7-4044-bc2c-f098c93f543e admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:24.628039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075f901-3cb7-4044-bc2c-f098c93f543e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:27:24.628399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075f901-3cb7-4044-bc2c-f098c93f543e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:24.630292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075f901-3cb7-4044-bc2c-f098c93f543e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:24.648493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1179/2366] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:27:24.650412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c64f31-ba2b-406a-bc43-20be5f011c4c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:24.660648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c64f31-ba2b-406a-bc43-20be5f011c4c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:24.665551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2fc25-293f-4256-97f6-6f891fd2b2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:24.666205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2fc25-293f-4256-97f6-6f891fd2b2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:24.666491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2fc25-293f-4256-97f6-6f891fd2b2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:24.666768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2fc25-293f-4256-97f6-6f891fd2b2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:24.667411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2fc25-293f-4256-97f6-6f891fd2b2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:24.669345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2fc25-293f-4256-97f6-6f891fd2b2f3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:24.700350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1188/2367] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:27:24 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:27:24.704080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075f901-3cb7-4044-bc2c-f098c93f543e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:24.718320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075f901-3cb7-4044-bc2c-f098c93f543e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:24.775635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8ba7-1cec-4378-993a-4f14694ef6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:24.776245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8ba7-1cec-4378-993a-4f14694ef6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:24.776525 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8ba7-1cec-4378-993a-4f14694ef6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:24.776795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c8ba7-1cec-4378-993a-4f14694ef6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:24.777420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c8ba7-1cec-4378-993a-4f14694ef6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:24.779357 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c8ba7-1cec-4378-993a-4f14694ef6d8 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:24.799329 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1180/2368] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:27:24 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:27:24.803760 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2fc25-293f-4256-97f6-6f891fd2b2f3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:24.814643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2fc25-293f-4256-97f6-6f891fd2b2f3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:24.820439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605078fa-372a-47c3-bc6d-96346aa1c943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:24.821654 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605078fa-372a-47c3-bc6d-96346aa1c943 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:24.821971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605078fa-372a-47c3-bc6d-96346aa1c943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:24.822279 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605078fa-372a-47c3-bc6d-96346aa1c943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:24.822925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605078fa-372a-47c3-bc6d-96346aa1c943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:24.824564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605078fa-372a-47c3-bc6d-96346aa1c943 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:24.834861 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1189/2369] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:24.838863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8ba7-1cec-4378-993a-4f14694ef6d8 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:24.849023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c8ba7-1cec-4378-993a-4f14694ef6d8 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:24.853658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1102f-7f36-4210-b823-fb405168ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:24.854292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1102f-7f36-4210-b823-fb405168ef55 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:24.854573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1102f-7f36-4210-b823-fb405168ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:24.854843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1102f-7f36-4210-b823-fb405168ef55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:24.855476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1102f-7f36-4210-b823-fb405168ef55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:24.857052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1102f-7f36-4210-b823-fb405168ef55 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:24.868048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1181/2370] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:24.872397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605078fa-372a-47c3-bc6d-96346aa1c943 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:24.882367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605078fa-372a-47c3-bc6d-96346aa1c943 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:24.887552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413a432-4ecb-4fb4-a97d-bbea11861555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:24.888191 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413a432-4ecb-4fb4-a97d-bbea11861555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:24.888472 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413a432-4ecb-4fb4-a97d-bbea11861555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:24.888748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413a432-4ecb-4fb4-a97d-bbea11861555 admin admin] PATH_INFO: `/v3/projects/af6ddb5f114145dca1df7196f6808ebb/users/07ea3b0c73704daea3fdae33f00b84aa/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:24.903631 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413a432-4ecb-4fb4-a97d-bbea11861555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6ddb5f114145dca1df7196f6808ebb, user_id=07ea3b0c73704daea3fdae33f00b84aa, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:24.906307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413a432-4ecb-4fb4-a97d-bbea11861555 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:24.919460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1190/2371] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:27:24 2022] PUT /identity/v3/projects/af6ddb5f114145dca1df7196f6808ebb/users/07ea3b0c73704daea3fdae33f00b84aa/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:24.929672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a315-12d6-4c5a-87bf-abddad9a3c85 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:24.930012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a315-12d6-4c5a-87bf-abddad9a3c85 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:24.930319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a315-12d6-4c5a-87bf-abddad9a3c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:24.938281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:24.958570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f0d4a315-12d6-4c5a-87bf-abddad9a3c85 None None] MFA Rules not processed for user `07ea3b0c73704daea3fdae33f00b84aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:24.959777 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f0d4a315-12d6-4c5a-87bf-abddad9a3c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:25.021732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1182/2372] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:25.033999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413a432-4ecb-4fb4-a97d-bbea11861555 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:25.035721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a413a432-4ecb-4fb4-a97d-bbea11861555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:25.051346 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:25.096042 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413a432-4ecb-4fb4-a97d-bbea11861555 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:25.099949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455b361-5ad8-489a-a4a4-9b8af1748192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:25.100516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455b361-5ad8-489a-a4a4-9b8af1748192 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:25.100800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455b361-5ad8-489a-a4a4-9b8af1748192 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:25.101095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455b361-5ad8-489a-a4a4-9b8af1748192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:25.110455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455b361-5ad8-489a-a4a4-9b8af1748192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:25.112363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455b361-5ad8-489a-a4a4-9b8af1748192 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:25.121516 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1191/2373] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:25.143906 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4a315-12d6-4c5a-87bf-abddad9a3c85 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:25.207967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4a315-12d6-4c5a-87bf-abddad9a3c85 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:25.213542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:25.214203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:25.214487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:25.214760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] PATH_INFO: `/v3/users/07ea3b0c73704daea3fdae33f00b84aa` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:25.215889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ea3b0c73704daea3fdae33f00b84aa)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:25.217809 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:25.263616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ea3b0c73704daea3fdae33f00b84aa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:25.264274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ea3b0c73704daea3fdae33f00b84aa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:25.264888 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ea3b0c73704daea3fdae33f00b84aa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:25.272234 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ea3b0c73704daea3fdae33f00b84aa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:25.279827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ea3b0c73704daea3fdae33f00b84aa'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:25.296500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1183/2374] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:27:25 2022] DELETE /identity/v3/users/07ea3b0c73704daea3fdae33f00b84aa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:25.301073 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf78a1-aaa6-413d-90fc-16dbc08fd2cc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:25.301533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf78a1-aaa6-413d-90fc-16dbc08fd2cc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:25.301652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf78a1-aaa6-413d-90fc-16dbc08fd2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:25.320325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e5bf78a1-aaa6-413d-90fc-16dbc08fd2cc None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:25.322120 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e5bf78a1-aaa6-413d-90fc-16dbc08fd2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:25.381102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1192/2375] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:25.391317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:25.392742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:25.407421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:25.453007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b7233-938d-4a8c-94b1-e120300f82f2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:25.456795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc0603-b406-4b32-9d59-5cc160a9ee5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:25.457396 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc0603-b406-4b32-9d59-5cc160a9ee5f service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:25.457688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc0603-b406-4b32-9d59-5cc160a9ee5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:25.457947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc0603-b406-4b32-9d59-5cc160a9ee5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:25.468207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc0603-b406-4b32-9d59-5cc160a9ee5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:25.469624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc0603-b406-4b32-9d59-5cc160a9ee5f service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:25.479904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1184/2376] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:25.822985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf78a1-aaa6-413d-90fc-16dbc08fd2cc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:25.824886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e5bf78a1-aaa6-413d-90fc-16dbc08fd2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:25.847938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf78a1-aaa6-413d-90fc-16dbc08fd2cc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:25.854180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:25.854731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:25.855090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:25.855259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] PATH_INFO: `/v3/projects/af6ddb5f114145dca1df7196f6808ebb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:25.856376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af6ddb5f114145dca1df7196f6808ebb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:25.858322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:25.904102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6ddb5f114145dca1df7196f6808ebb', 'request_id': 'req-0b191f07-5182-4ea6-bcb9-569205661a73'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:25.909486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6ddb5f114145dca1df7196f6808ebb', 'request_id': 'req-0b191f07-5182-4ea6-bcb9-569205661a73'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:25.917231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6ddb5f114145dca1df7196f6808ebb', 'request_id': 'req-0b191f07-5182-4ea6-bcb9-569205661a73'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:25.928273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] The token cache is being invalidate because project af6ddb5f114145dca1df7196f6808ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:27:25.928551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:25.929166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0b191f07-5182-4ea6-bcb9-569205661a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:25.931328 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1193/2377] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:27:25 2022] DELETE /identity/v3/projects/af6ddb5f114145dca1df7196f6808ebb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:25.938125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3c909-fb92-4b05-b25e-d724b766d0a9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:25.938415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3c909-fb92-4b05-b25e-d724b766d0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:25.938725 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3c909-fb92-4b05-b25e-d724b766d0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:25.957425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b6d3c909-fb92-4b05-b25e-d724b766d0a9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:25.958653 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b6d3c909-fb92-4b05-b25e-d724b766d0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:26.015743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1185/2378] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:26.023368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35cc23-e758-4dd8-a90c-360675377492 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:26.023839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35cc23-e758-4dd8-a90c-360675377492 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:26.024209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35cc23-e758-4dd8-a90c-360675377492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:26.043751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8c35cc23-e758-4dd8-a90c-360675377492 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:26.044930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8c35cc23-e758-4dd8-a90c-360675377492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:26.052618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1194/2379] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:26.057458 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3c909-fb92-4b05-b25e-d724b766d0a9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:26.067039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3c909-fb92-4b05-b25e-d724b766d0a9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:26.071588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628af6a4-81a5-4055-8f03-8142cdf0756c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:26.072185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628af6a4-81a5-4055-8f03-8142cdf0756c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:26.072462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628af6a4-81a5-4055-8f03-8142cdf0756c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:26.072731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628af6a4-81a5-4055-8f03-8142cdf0756c admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:26.073374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628af6a4-81a5-4055-8f03-8142cdf0756c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:27:26.073677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628af6a4-81a5-4055-8f03-8142cdf0756c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:26.075292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628af6a4-81a5-4055-8f03-8142cdf0756c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:26.086479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1186/2380] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:27:26.090854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35cc23-e758-4dd8-a90c-360675377492 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:26.100239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35cc23-e758-4dd8-a90c-360675377492 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:26.105841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9e378-6030-41e7-b8c0-9103076560e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:26.106540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9e378-6030-41e7-b8c0-9103076560e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:26.106929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9e378-6030-41e7-b8c0-9103076560e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:26.107204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9e378-6030-41e7-b8c0-9103076560e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:26.107828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9e378-6030-41e7-b8c0-9103076560e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:26.109693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9e378-6030-41e7-b8c0-9103076560e8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:26.137766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1195/2381] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:27:26 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:27:26.142000 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628af6a4-81a5-4055-8f03-8142cdf0756c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:26.152076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628af6a4-81a5-4055-8f03-8142cdf0756c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:26.207887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b200e-68c6-4365-bc87-0816fb07a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:26.208411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b200e-68c6-4365-bc87-0816fb07a282 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:26.208695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b200e-68c6-4365-bc87-0816fb07a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:26.208968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b200e-68c6-4365-bc87-0816fb07a282 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:26.209583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b200e-68c6-4365-bc87-0816fb07a282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:26.211593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b200e-68c6-4365-bc87-0816fb07a282 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:26.235064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1187/2382] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:27:26 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:27:26.236277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9e378-6030-41e7-b8c0-9103076560e8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:26.247746 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9e378-6030-41e7-b8c0-9103076560e8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:26.252291 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d032b-3086-4bcc-8a20-afe26a9f5eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:26.252879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d032b-3086-4bcc-8a20-afe26a9f5eac admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:26.253155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d032b-3086-4bcc-8a20-afe26a9f5eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:26.253423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d032b-3086-4bcc-8a20-afe26a9f5eac admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:26.254083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d032b-3086-4bcc-8a20-afe26a9f5eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:26.255658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d032b-3086-4bcc-8a20-afe26a9f5eac admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:26.260744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:26.266895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1196/2383] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:26.270494 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b200e-68c6-4365-bc87-0816fb07a282 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:26.280914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b200e-68c6-4365-bc87-0816fb07a282 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:26.285788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b285f5-e827-4be0-a447-cbc1e2da43c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:26.286417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b285f5-e827-4be0-a447-cbc1e2da43c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:26.286699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b285f5-e827-4be0-a447-cbc1e2da43c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:26.286973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b285f5-e827-4be0-a447-cbc1e2da43c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:26.287613 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b285f5-e827-4be0-a447-cbc1e2da43c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:26.289793 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b285f5-e827-4be0-a447-cbc1e2da43c5 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:26.299515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1188/2384] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:27:26.303394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d032b-3086-4bcc-8a20-afe26a9f5eac admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:26.313808 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d032b-3086-4bcc-8a20-afe26a9f5eac admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:26.318782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f097632-94e7-4ee2-8a07-44031ab091c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:26.319560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097632-94e7-4ee2-8a07-44031ab091c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:26.319834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097632-94e7-4ee2-8a07-44031ab091c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:26.320101 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f097632-94e7-4ee2-8a07-44031ab091c2 admin admin] PATH_INFO: `/v3/projects/0000e1f41911487cb60d491686df100b/users/af486cf392ad4885941112be5f301be5/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:26.335705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f097632-94e7-4ee2-8a07-44031ab091c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0000e1f41911487cb60d491686df100b, user_id=af486cf392ad4885941112be5f301be5, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:26.338950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f097632-94e7-4ee2-8a07-44031ab091c2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:26.352412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1197/2385] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:27:26 2022] PUT /identity/v3/projects/0000e1f41911487cb60d491686df100b/users/af486cf392ad4885941112be5f301be5/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:26.362618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509902ec-a35a-4112-8e0d-ea11d6ac5952 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:26.362989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509902ec-a35a-4112-8e0d-ea11d6ac5952 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:26.363342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509902ec-a35a-4112-8e0d-ea11d6ac5952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:26.393008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-509902ec-a35a-4112-8e0d-ea11d6ac5952 None None] MFA Rules not processed for user `af486cf392ad4885941112be5f301be5`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:26.394313 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-509902ec-a35a-4112-8e0d-ea11d6ac5952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:26.405086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:26.463310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1189/2386] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:27:26.474430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f097632-94e7-4ee2-8a07-44031ab091c2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:26.476130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7f097632-94e7-4ee2-8a07-44031ab091c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:26.544373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f097632-94e7-4ee2-8a07-44031ab091c2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:26.548357 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fa230-1aef-4311-b333-d849b5492633 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23bb3a6586247e0a11ece33569d6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:26.549092 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa230-1aef-4311-b333-d849b5492633 service glance] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:26.549533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa230-1aef-4311-b333-d849b5492633 service glance] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:26.549871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa230-1aef-4311-b333-d849b5492633 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:26.562375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fa230-1aef-4311-b333-d849b5492633 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:26.563804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fa230-1aef-4311-b333-d849b5492633 service glance] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:26.573797 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1198/2387] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:30.636743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509902ec-a35a-4112-8e0d-ea11d6ac5952 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:30.638921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-509902ec-a35a-4112-8e0d-ea11d6ac5952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:30.705625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509902ec-a35a-4112-8e0d-ea11d6ac5952 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:30.709556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189ff37-e294-4b5b-a957-c99f6bd20f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:30.710202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189ff37-e294-4b5b-a957-c99f6bd20f0b service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:30.710490 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189ff37-e294-4b5b-a957-c99f6bd20f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:30.710763 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189ff37-e294-4b5b-a957-c99f6bd20f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:30.712559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2189ff37-e294-4b5b-a957-c99f6bd20f0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:30.723410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189ff37-e294-4b5b-a957-c99f6bd20f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:30.724904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189ff37-e294-4b5b-a957-c99f6bd20f0b service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:30.734806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1190/2388] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:36.568589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:39.078747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80900-4331-4e3f-af3f-d64eb6ce80b5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:39.079352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80900-4331-4e3f-af3f-d64eb6ce80b5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:39.079541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80900-4331-4e3f-af3f-d64eb6ce80b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:39.099521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-47a80900-4331-4e3f-af3f-d64eb6ce80b5 None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:39.100737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-47a80900-4331-4e3f-af3f-d64eb6ce80b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:39.158481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1199/2389] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:27:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:39.220233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189ff37-e294-4b5b-a957-c99f6bd20f0b service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:39.221920 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2189ff37-e294-4b5b-a957-c99f6bd20f0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:39.292855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189ff37-e294-4b5b-a957-c99f6bd20f0b service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:39.297952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a630e01-6eb8-44f8-96d5-67822eaae25a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:39.298596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a630e01-6eb8-44f8-96d5-67822eaae25a service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:39.298877 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a630e01-6eb8-44f8-96d5-67822eaae25a service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:39.299149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a630e01-6eb8-44f8-96d5-67822eaae25a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:39.307123 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a630e01-6eb8-44f8-96d5-67822eaae25a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:39.308693 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a630e01-6eb8-44f8-96d5-67822eaae25a service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:39.316953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1191/2390] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:27:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:27:42.254084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a80900-4331-4e3f-af3f-d64eb6ce80b5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:42.323692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a80900-4331-4e3f-af3f-d64eb6ce80b5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:42.328761 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:42.329458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:42.329749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:42.330567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] PATH_INFO: `/v3/users/af486cf392ad4885941112be5f301be5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:42.331259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af486cf392ad4885941112be5f301be5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:42.333183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:42.395125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af486cf392ad4885941112be5f301be5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:42.403075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af486cf392ad4885941112be5f301be5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:42.420560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af486cf392ad4885941112be5f301be5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:42.432338 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af486cf392ad4885941112be5f301be5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:42.433113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af486cf392ad4885941112be5f301be5'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:42.441302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1200/2391] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:27:42 2022] DELETE /identity/v3/users/af486cf392ad4885941112be5f301be5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:42.445773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc14c-8930-4680-83e1-10cdfa6f110c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:42.446298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc14c-8930-4680-83e1-10cdfa6f110c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:42.446404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfc14c-8930-4680-83e1-10cdfa6f110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:42.466428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e5cfc14c-8930-4680-83e1-10cdfa6f110c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:42.467887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e5cfc14c-8930-4680-83e1-10cdfa6f110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:42.516954 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:42.538153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1192/2392] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:42.548130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:42.550067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:42.600980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:42.635248 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4b72-6a4f-4450-a85f-825649afda13 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:42.639905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0ce2d-f0a3-49cf-be95-96de829c7966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:42.640623 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0ce2d-f0a3-49cf-be95-96de829c7966 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:42.641017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0ce2d-f0a3-49cf-be95-96de829c7966 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:42.641368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0ce2d-f0a3-49cf-be95-96de829c7966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:42.651456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0ce2d-f0a3-49cf-be95-96de829c7966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:42.653562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0ce2d-f0a3-49cf-be95-96de829c7966 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:42.664293 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1201/2393] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:27:42.985365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc14c-8930-4680-83e1-10cdfa6f110c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:42.986932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e5cfc14c-8930-4680-83e1-10cdfa6f110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:43.009404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfc14c-8930-4680-83e1-10cdfa6f110c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:43.019562 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:43.021138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:43.021568 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:43.021817 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] PATH_INFO: `/v3/projects/0000e1f41911487cb60d491686df100b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:43.023068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0000e1f41911487cb60d491686df100b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:43.025405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:43.106808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0000e1f41911487cb60d491686df100b', 'request_id': 'req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:43.115231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0000e1f41911487cb60d491686df100b', 'request_id': 'req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:43.127728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0000e1f41911487cb60d491686df100b', 'request_id': 'req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:43.142570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] The token cache is being invalidate because project 0000e1f41911487cb60d491686df100b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:27:43.142989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:43.143858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5136d5fc-d6ed-42e2-ad84-b735a3caac4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:43.145365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1193/2394] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:27:42 2022] DELETE /identity/v3/projects/0000e1f41911487cb60d491686df100b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:43.150372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397da807-2188-4047-be63-30dea831be3e None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:43.150681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397da807-2188-4047-be63-30dea831be3e None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:43.151020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397da807-2188-4047-be63-30dea831be3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:43.186077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-397da807-2188-4047-be63-30dea831be3e None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:43.187473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-397da807-2188-4047-be63-30dea831be3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:43.258191 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1202/2395] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:43.265517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b0470-daa5-49f2-9e9c-ef24daf4a055 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:43.265696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b0470-daa5-49f2-9e9c-ef24daf4a055 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:43.265892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b0470-daa5-49f2-9e9c-ef24daf4a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:43.289201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-778b0470-daa5-49f2-9e9c-ef24daf4a055 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:43.290443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-778b0470-daa5-49f2-9e9c-ef24daf4a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:43.301650 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1194/2396] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:43.305928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397da807-2188-4047-be63-30dea831be3e None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:43.316614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397da807-2188-4047-be63-30dea831be3e None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:43.321619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8b2d4-b6c3-49ac-956e-89db0e8eff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:43.322335 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8b2d4-b6c3-49ac-956e-89db0e8eff8d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:43.322689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8b2d4-b6c3-49ac-956e-89db0e8eff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:43.323057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8b2d4-b6c3-49ac-956e-89db0e8eff8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:43.323776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8b2d4-b6c3-49ac-956e-89db0e8eff8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:27:43.324712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8b2d4-b6c3-49ac-956e-89db0e8eff8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:43.326497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8b2d4-b6c3-49ac-956e-89db0e8eff8d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:43.345195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1203/2397] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:27:43.347018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b0470-daa5-49f2-9e9c-ef24daf4a055 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:43.357853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b0470-daa5-49f2-9e9c-ef24daf4a055 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:43.363420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca67d6-7000-4c3b-919c-2a40207e874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:43.364039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca67d6-7000-4c3b-919c-2a40207e874b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:43.364486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca67d6-7000-4c3b-919c-2a40207e874b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:43.364858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca67d6-7000-4c3b-919c-2a40207e874b admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:43.365405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca67d6-7000-4c3b-919c-2a40207e874b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:43.367732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca67d6-7000-4c3b-919c-2a40207e874b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:43.402312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1195/2398] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:27:43 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:27:43.403653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8b2d4-b6c3-49ac-956e-89db0e8eff8d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:43.414503 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8b2d4-b6c3-49ac-956e-89db0e8eff8d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:43.489245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a8c5d-3760-43aa-be65-79b7d4093c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:43.489887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a8c5d-3760-43aa-be65-79b7d4093c4f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:43.490415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a8c5d-3760-43aa-be65-79b7d4093c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:43.490695 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a8c5d-3760-43aa-be65-79b7d4093c4f admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:43.491297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a8c5d-3760-43aa-be65-79b7d4093c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:43.493313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a8c5d-3760-43aa-be65-79b7d4093c4f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:43.520672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1204/2399] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:27:43 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:27:43.526440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca67d6-7000-4c3b-919c-2a40207e874b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:43.552087 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca67d6-7000-4c3b-919c-2a40207e874b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:43.565843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f597c-bfda-4565-b61e-22bff29c8a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:43.566976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f597c-bfda-4565-b61e-22bff29c8a97 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:43.567455 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f597c-bfda-4565-b61e-22bff29c8a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:43.567788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f597c-bfda-4565-b61e-22bff29c8a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:43.568503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f597c-bfda-4565-b61e-22bff29c8a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:43.570855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f597c-bfda-4565-b61e-22bff29c8a97 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:43.598843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1196/2400] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:43.600044 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a8c5d-3760-43aa-be65-79b7d4093c4f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:43.612463 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a8c5d-3760-43aa-be65-79b7d4093c4f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:43.618456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa1594-7d5d-4440-be29-40317a586935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:43.619226 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1594-7d5d-4440-be29-40317a586935 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:43.619507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1594-7d5d-4440-be29-40317a586935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:43.619779 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa1594-7d5d-4440-be29-40317a586935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:43.620438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa1594-7d5d-4440-be29-40317a586935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:43.622181 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa1594-7d5d-4440-be29-40317a586935 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:43.637693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1205/2401] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:43.640586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f597c-bfda-4565-b61e-22bff29c8a97 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:43.651179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f597c-bfda-4565-b61e-22bff29c8a97 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:43.656796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c48de-13d2-436d-8ac5-4c081f0933ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:43.657556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c48de-13d2-436d-8ac5-4c081f0933ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:43.657911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c48de-13d2-436d-8ac5-4c081f0933ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:43.658297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c48de-13d2-436d-8ac5-4c081f0933ef admin admin] PATH_INFO: `/v3/projects/97d881ea585f4668acc45a5beef095cc/users/759b81c342d343df9913cbc6512a6faa/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:43.674515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c48de-13d2-436d-8ac5-4c081f0933ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d881ea585f4668acc45a5beef095cc, user_id=759b81c342d343df9913cbc6512a6faa, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:43.677342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c48de-13d2-436d-8ac5-4c081f0933ef admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:43.696760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1197/2402] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:27:43 2022] PUT /identity/v3/projects/97d881ea585f4668acc45a5beef095cc/users/759b81c342d343df9913cbc6512a6faa/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:43.710393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101676a-b093-4310-9b1c-f22e41c373cc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:43.710689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101676a-b093-4310-9b1c-f22e41c373cc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:43.711254 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101676a-b093-4310-9b1c-f22e41c373cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:43.746774 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2101676a-b093-4310-9b1c-f22e41c373cc None None] MFA Rules not processed for user `759b81c342d343df9913cbc6512a6faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:43.748123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2101676a-b093-4310-9b1c-f22e41c373cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:43.774551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:43.835953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1206/2403] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:43.846524 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c48de-13d2-436d-8ac5-4c081f0933ef admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:43.850132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-935c48de-13d2-436d-8ac5-4c081f0933ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:43.923857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c48de-13d2-436d-8ac5-4c081f0933ef admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:43.930971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d877e4-49f8-4ccb-bbef-7e134f7a0100 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:43.931715 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d877e4-49f8-4ccb-bbef-7e134f7a0100 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:43.932102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d877e4-49f8-4ccb-bbef-7e134f7a0100 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:43.932422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d877e4-49f8-4ccb-bbef-7e134f7a0100 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:43.942891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d877e4-49f8-4ccb-bbef-7e134f7a0100 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:43.944444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d877e4-49f8-4ccb-bbef-7e134f7a0100 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:43.956512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1198/2404] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:47.382819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101676a-b093-4310-9b1c-f22e41c373cc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:47.458048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101676a-b093-4310-9b1c-f22e41c373cc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:47.462894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:47.463624 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:47.463974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:47.464313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] PATH_INFO: `/v3/users/759b81c342d343df9913cbc6512a6faa` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:47.466166 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=759b81c342d343df9913cbc6512a6faa)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:47.468113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:47.532790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759b81c342d343df9913cbc6512a6faa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:47.540709 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759b81c342d343df9913cbc6512a6faa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:47.564886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759b81c342d343df9913cbc6512a6faa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:47.579344 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759b81c342d343df9913cbc6512a6faa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:47.580036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759b81c342d343df9913cbc6512a6faa'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:47.590069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1207/2405] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:27:47 2022] DELETE /identity/v3/users/759b81c342d343df9913cbc6512a6faa => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:47.592467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c5bbb-2632-48e5-bb0a-fc303407bcc4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:47.592976 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c5bbb-2632-48e5-bb0a-fc303407bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:47.593086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c5bbb-2632-48e5-bb0a-fc303407bcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:47.608451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:47.616422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-955c5bbb-2632-48e5-bb0a-fc303407bcc4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:47.618530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-955c5bbb-2632-48e5-bb0a-fc303407bcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:47.690720 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1199/2406] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:47.701294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:47.702979 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:47.759829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:47.776800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b4125-1896-4538-970f-07be1b239ecd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:47.780883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901462f8-7b07-4eee-987d-5e0792f7a137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:47.781556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901462f8-7b07-4eee-987d-5e0792f7a137 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:47.781815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901462f8-7b07-4eee-987d-5e0792f7a137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:47.782130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901462f8-7b07-4eee-987d-5e0792f7a137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:47.792398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901462f8-7b07-4eee-987d-5e0792f7a137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:47.793964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901462f8-7b07-4eee-987d-5e0792f7a137 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:47.805261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1208/2407] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:48.149149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c5bbb-2632-48e5-bb0a-fc303407bcc4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:48.150598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-955c5bbb-2632-48e5-bb0a-fc303407bcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:48.179639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c5bbb-2632-48e5-bb0a-fc303407bcc4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:48.193798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:48.195034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:48.195470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:48.196213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] PATH_INFO: `/v3/projects/97d881ea585f4668acc45a5beef095cc` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:48.197679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d881ea585f4668acc45a5beef095cc)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:48.199899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:48.294824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d881ea585f4668acc45a5beef095cc', 'request_id': 'req-61ce409f-a220-4434-be86-6ecf794e1271'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:48.302248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d881ea585f4668acc45a5beef095cc', 'request_id': 'req-61ce409f-a220-4434-be86-6ecf794e1271'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:48.311486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d881ea585f4668acc45a5beef095cc', 'request_id': 'req-61ce409f-a220-4434-be86-6ecf794e1271'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:48.330217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] The token cache is being invalidate because project 97d881ea585f4668acc45a5beef095cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:27:48.330574 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:48.331218 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-61ce409f-a220-4434-be86-6ecf794e1271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:48.336765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1200/2408] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:27:48 2022] DELETE /identity/v3/projects/97d881ea585f4668acc45a5beef095cc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:48.338613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e9483-416b-4ba8-92a5-3563499944f8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:48.339007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e9483-416b-4ba8-92a5-3563499944f8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:48.339381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e9483-416b-4ba8-92a5-3563499944f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:48.376845 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d49e9483-416b-4ba8-92a5-3563499944f8 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:48.378402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d49e9483-416b-4ba8-92a5-3563499944f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:48.463370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1209/2409] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:27:48.471081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09d8c-85d9-4eaf-8fec-1ed95db8ee0a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:48.472034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09d8c-85d9-4eaf-8fec-1ed95db8ee0a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:48.472378 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b09d8c-85d9-4eaf-8fec-1ed95db8ee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:48.501689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-94b09d8c-85d9-4eaf-8fec-1ed95db8ee0a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:48.503131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-94b09d8c-85d9-4eaf-8fec-1ed95db8ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:48.517995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1201/2410] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:48.520961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e9483-416b-4ba8-92a5-3563499944f8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:48.532412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e9483-416b-4ba8-92a5-3563499944f8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:48.537302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e998357-b3a8-4201-b672-45eee9ea917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:48.537907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e998357-b3a8-4201-b672-45eee9ea917f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:48.538218 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e998357-b3a8-4201-b672-45eee9ea917f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:48.538492 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e998357-b3a8-4201-b672-45eee9ea917f admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:48.539135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e998357-b3a8-4201-b672-45eee9ea917f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:27:48.539436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e998357-b3a8-4201-b672-45eee9ea917f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:48.541017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e998357-b3a8-4201-b672-45eee9ea917f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:48.559227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1210/2411] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:27:48.561163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b09d8c-85d9-4eaf-8fec-1ed95db8ee0a None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:48.571070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b09d8c-85d9-4eaf-8fec-1ed95db8ee0a None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:48.577021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb96ed5-2159-4384-b223-44093a8151cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:48.577820 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb96ed5-2159-4384-b223-44093a8151cb admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:48.578292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb96ed5-2159-4384-b223-44093a8151cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:48.578731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb96ed5-2159-4384-b223-44093a8151cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:48.579509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb96ed5-2159-4384-b223-44093a8151cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:48.581390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb96ed5-2159-4384-b223-44093a8151cb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:48.611963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1202/2412] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:27:48 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:27:48.615831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e998357-b3a8-4201-b672-45eee9ea917f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:48.627331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e998357-b3a8-4201-b672-45eee9ea917f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:48.689193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688222ce-eeb5-4568-9196-a75bb5dd201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:48.689924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688222ce-eeb5-4568-9196-a75bb5dd201b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:48.690297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688222ce-eeb5-4568-9196-a75bb5dd201b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:48.690567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688222ce-eeb5-4568-9196-a75bb5dd201b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:48.691196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688222ce-eeb5-4568-9196-a75bb5dd201b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:48.693146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688222ce-eeb5-4568-9196-a75bb5dd201b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:48.723006 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1211/2413] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:27:48 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:27:48.727473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb96ed5-2159-4384-b223-44093a8151cb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:48.739393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb96ed5-2159-4384-b223-44093a8151cb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:48.744662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c2221-8a48-4c55-bcf6-3390f0cc2085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:48.745338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c2221-8a48-4c55-bcf6-3390f0cc2085 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:48.745705 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c2221-8a48-4c55-bcf6-3390f0cc2085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:48.746646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c2221-8a48-4c55-bcf6-3390f0cc2085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:48.747355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c2221-8a48-4c55-bcf6-3390f0cc2085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:48.749013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c2221-8a48-4c55-bcf6-3390f0cc2085 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:48.761738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1203/2414] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:48.765897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688222ce-eeb5-4568-9196-a75bb5dd201b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:48.775857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688222ce-eeb5-4568-9196-a75bb5dd201b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:48.780845 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d5410-6aec-42df-af7b-19ae01901392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:48.781442 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5410-6aec-42df-af7b-19ae01901392 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:48.781717 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5410-6aec-42df-af7b-19ae01901392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:48.781987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d5410-6aec-42df-af7b-19ae01901392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:48.782654 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d5410-6aec-42df-af7b-19ae01901392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:48.784287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d5410-6aec-42df-af7b-19ae01901392 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:48.795478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1212/2415] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:27:48.799628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c2221-8a48-4c55-bcf6-3390f0cc2085 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:48.811790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c2221-8a48-4c55-bcf6-3390f0cc2085 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:48.816766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14705eb-ee18-45ca-a2dc-e6c0a33dd22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:48.817424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14705eb-ee18-45ca-a2dc-e6c0a33dd22b admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:48.817707 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14705eb-ee18-45ca-a2dc-e6c0a33dd22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:48.817999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14705eb-ee18-45ca-a2dc-e6c0a33dd22b admin admin] PATH_INFO: `/v3/projects/d342015260994721b43c330d685724ae/users/9b72ac0fbb5e4cc39ad58dd0aeb18256/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:48.833741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14705eb-ee18-45ca-a2dc-e6c0a33dd22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d342015260994721b43c330d685724ae, user_id=9b72ac0fbb5e4cc39ad58dd0aeb18256, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:48.836894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14705eb-ee18-45ca-a2dc-e6c0a33dd22b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:48.850493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1204/2416] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:27:48 2022] PUT /identity/v3/projects/d342015260994721b43c330d685724ae/users/9b72ac0fbb5e4cc39ad58dd0aeb18256/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:48.862163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522e934-4018-4959-a62e-3f79ec1ba466 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:48.862487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522e934-4018-4959-a62e-3f79ec1ba466 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:48.862845 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522e934-4018-4959-a62e-3f79ec1ba466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:48.893203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2522e934-4018-4959-a62e-3f79ec1ba466 None None] MFA Rules not processed for user `9b72ac0fbb5e4cc39ad58dd0aeb18256`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:48.894431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2522e934-4018-4959-a62e-3f79ec1ba466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:49.057670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:49.083522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1213/2417] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:49.088011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14705eb-ee18-45ca-a2dc-e6c0a33dd22b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:49.117362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:49.130454 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522e934-4018-4959-a62e-3f79ec1ba466 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:49.131811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2522e934-4018-4959-a62e-3f79ec1ba466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:49.154246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14705eb-ee18-45ca-a2dc-e6c0a33dd22b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:49.159027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df861159-85cc-4dbd-8249-f26d1bd2c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:49.159633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861159-85cc-4dbd-8249-f26d1bd2c471 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:49.159922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861159-85cc-4dbd-8249-f26d1bd2c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:49.160194 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df861159-85cc-4dbd-8249-f26d1bd2c471 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:49.160920 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df861159-85cc-4dbd-8249-f26d1bd2c471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:49.162915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df861159-85cc-4dbd-8249-f26d1bd2c471 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:49.189708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1205/2418] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:27:49 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:27:49.193664 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df861159-85cc-4dbd-8249-f26d1bd2c471 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:49.207483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522e934-4018-4959-a62e-3f79ec1ba466 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:49.255380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df861159-85cc-4dbd-8249-f26d1bd2c471 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:49.260467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032bfbb-5323-4749-ae53-a5969126de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:49.261143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032bfbb-5323-4749-ae53-a5969126de69 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:49.262075 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032bfbb-5323-4749-ae53-a5969126de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:49.262398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032bfbb-5323-4749-ae53-a5969126de69 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:49.263089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032bfbb-5323-4749-ae53-a5969126de69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:49.264990 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032bfbb-5323-4749-ae53-a5969126de69 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:49.268435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6af48-2dfa-4630-8f0c-3834e23d1ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:49.269038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6af48-2dfa-4630-8f0c-3834e23d1ba8 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:49.269314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6af48-2dfa-4630-8f0c-3834e23d1ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:49.269580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6af48-2dfa-4630-8f0c-3834e23d1ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:49.271337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-32d6af48-2dfa-4630-8f0c-3834e23d1ba8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:49.285439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1206/2419] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:27:49 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:27:49.289259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032bfbb-5323-4749-ae53-a5969126de69 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:49.298680 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032bfbb-5323-4749-ae53-a5969126de69 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:49.303632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4ee4-4f46-40d7-b562-81128c85340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:49.304252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4ee4-4f46-40d7-b562-81128c85340b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:49.304530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4ee4-4f46-40d7-b562-81128c85340b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:49.304798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4ee4-4f46-40d7-b562-81128c85340b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:49.305530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a4ee4-4f46-40d7-b562-81128c85340b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:49.307243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a4ee4-4f46-40d7-b562-81128c85340b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:49.319416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1207/2420] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:27:49.324724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4ee4-4f46-40d7-b562-81128c85340b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:49.335695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4ee4-4f46-40d7-b562-81128c85340b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:49.341125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b127b-2a7e-403a-b0ca-cba0518bb672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:49.341342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6af48-2dfa-4630-8f0c-3834e23d1ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:49.341825 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b127b-2a7e-403a-b0ca-cba0518bb672 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:49.342144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b127b-2a7e-403a-b0ca-cba0518bb672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:49.342420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b127b-2a7e-403a-b0ca-cba0518bb672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:49.343070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b127b-2a7e-403a-b0ca-cba0518bb672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:49.343967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6af48-2dfa-4630-8f0c-3834e23d1ba8 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:49.345167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b127b-2a7e-403a-b0ca-cba0518bb672 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:49.355376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1214/2421] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:27:49.358006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1208/2422] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:27:49.362508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6af48-2dfa-4630-8f0c-3834e23d1ba8 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:49.373884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6af48-2dfa-4630-8f0c-3834e23d1ba8 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:49.378529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a992-bf5a-4b8b-ba1b-b9d553d3f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:49.379182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a992-bf5a-4b8b-ba1b-b9d553d3f4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:49.379457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a992-bf5a-4b8b-ba1b-b9d553d3f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:49.379752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a992-bf5a-4b8b-ba1b-b9d553d3f4a6 admin admin] PATH_INFO: `/v3/projects/38894b6a692c483cb378690cbba4da0f/users/9b7a279eae224c38926c26639fa91e02/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:49.392048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:49.395494 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18a992-bf5a-4b8b-ba1b-b9d553d3f4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38894b6a692c483cb378690cbba4da0f, user_id=9b7a279eae224c38926c26639fa91e02, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:49.398250 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18a992-bf5a-4b8b-ba1b-b9d553d3f4a6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:49.412122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1215/2423] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:27:49 2022] PUT /identity/v3/projects/38894b6a692c483cb378690cbba4da0f/users/9b7a279eae224c38926c26639fa91e02/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:49.424013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92372-f62c-4b33-b35d-a3ddb409470e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:49.424306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92372-f62c-4b33-b35d-a3ddb409470e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:49.424741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92372-f62c-4b33-b35d-a3ddb409470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:49.456419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0ee92372-f62c-4b33-b35d-a3ddb409470e None None] MFA Rules not processed for user `9b7a279eae224c38926c26639fa91e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:49.457850 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ee92372-f62c-4b33-b35d-a3ddb409470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:49.532820 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1209/2424] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:49.536903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a992-bf5a-4b8b-ba1b-b9d553d3f4a6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:49.637685 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18a992-bf5a-4b8b-ba1b-b9d553d3f4a6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:49.644303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e10452-e5eb-41c1-a0ad-af7f48ebb98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:49.645142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e10452-e5eb-41c1-a0ad-af7f48ebb98e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:49.645773 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e10452-e5eb-41c1-a0ad-af7f48ebb98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:49.646146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e10452-e5eb-41c1-a0ad-af7f48ebb98e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:49.647476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e10452-e5eb-41c1-a0ad-af7f48ebb98e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:49.649519 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e10452-e5eb-41c1-a0ad-af7f48ebb98e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:49.766071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1216/2425] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:27:49 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:27:49.769375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee92372-f62c-4b33-b35d-a3ddb409470e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:49.783535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee92372-f62c-4b33-b35d-a3ddb409470e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:49.789006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:49.845821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba45701-2f69-4452-86c4-3cd08c7849ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:49.846456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45701-2f69-4452-86c4-3cd08c7849ee admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:49.846999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45701-2f69-4452-86c4-3cd08c7849ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:49.847269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba45701-2f69-4452-86c4-3cd08c7849ee admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:49.847885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba45701-2f69-4452-86c4-3cd08c7849ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:49.849847 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba45701-2f69-4452-86c4-3cd08c7849ee admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:49.876613 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1210/2426] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:27:49 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:27:49.877815 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e10452-e5eb-41c1-a0ad-af7f48ebb98e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:49.888864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e10452-e5eb-41c1-a0ad-af7f48ebb98e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:49.893600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b549ebb-ef81-4938-9d47-2c9914dd4b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:49.894246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b549ebb-ef81-4938-9d47-2c9914dd4b29 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:49.894530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b549ebb-ef81-4938-9d47-2c9914dd4b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:49.894806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b549ebb-ef81-4938-9d47-2c9914dd4b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:49.895453 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b549ebb-ef81-4938-9d47-2c9914dd4b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:49.897036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b549ebb-ef81-4938-9d47-2c9914dd4b29 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:49.906970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1217/2427] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:49.911390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba45701-2f69-4452-86c4-3cd08c7849ee admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:49.921387 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba45701-2f69-4452-86c4-3cd08c7849ee admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:49.925988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabcf8c-8e4d-4c70-97bd-09a8fc427733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:49.926677 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabcf8c-8e4d-4c70-97bd-09a8fc427733 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:49.926957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabcf8c-8e4d-4c70-97bd-09a8fc427733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:49.927230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabcf8c-8e4d-4c70-97bd-09a8fc427733 admin admin] PATH_INFO: `/v3/projects/2dd65ea7bfd84cecaeca5ea92db55652/users/bf6239085cd745edb9c400b8b8de743a/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:49.942559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabcf8c-8e4d-4c70-97bd-09a8fc427733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd65ea7bfd84cecaeca5ea92db55652, user_id=bf6239085cd745edb9c400b8b8de743a, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:49.945205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabcf8c-8e4d-4c70-97bd-09a8fc427733 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:49.959514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1211/2428] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:27:49 2022] PUT /identity/v3/projects/2dd65ea7bfd84cecaeca5ea92db55652/users/bf6239085cd745edb9c400b8b8de743a/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:49.963553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b549ebb-ef81-4938-9d47-2c9914dd4b29 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:49.974353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b549ebb-ef81-4938-9d47-2c9914dd4b29 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:50.030385 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731faea-f4e4-42d5-9d6d-a1bfb2c35f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:50.030993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731faea-f4e4-42d5-9d6d-a1bfb2c35f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:50.031275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731faea-f4e4-42d5-9d6d-a1bfb2c35f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:50.031554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731faea-f4e4-42d5-9d6d-a1bfb2c35f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:50.032195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731faea-f4e4-42d5-9d6d-a1bfb2c35f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:50.033793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731faea-f4e4-42d5-9d6d-a1bfb2c35f8a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:50.044032 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1218/2429] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:50.048232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabcf8c-8e4d-4c70-97bd-09a8fc427733 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:50.059037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabcf8c-8e4d-4c70-97bd-09a8fc427733 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:50.063710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d384b46-83ad-40ba-a786-49a76f844bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:50.064363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d384b46-83ad-40ba-a786-49a76f844bca admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:50.064643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d384b46-83ad-40ba-a786-49a76f844bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:50.064914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d384b46-83ad-40ba-a786-49a76f844bca admin admin] PATH_INFO: `/v3/projects/2dd65ea7bfd84cecaeca5ea92db55652/users/bf6239085cd745edb9c400b8b8de743a/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:50.066957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d384b46-83ad-40ba-a786-49a76f844bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dd65ea7bfd84cecaeca5ea92db55652, user_id=bf6239085cd745edb9c400b8b8de743a, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:50.069591 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d384b46-83ad-40ba-a786-49a76f844bca admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:50.080631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1212/2430] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:27:50 2022] PUT /identity/v3/projects/2dd65ea7bfd84cecaeca5ea92db55652/users/bf6239085cd745edb9c400b8b8de743a/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:50.091305 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035356e-7cb1-4943-ab89-f5c81051078f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:50.091648 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035356e-7cb1-4943-ab89-f5c81051078f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:50.091935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035356e-7cb1-4943-ab89-f5c81051078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:50.120383 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f035356e-7cb1-4943-ab89-f5c81051078f None None] MFA Rules not processed for user `bf6239085cd745edb9c400b8b8de743a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:50.122207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f035356e-7cb1-4943-ab89-f5c81051078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:50.172018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:50.202041 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1219/2431] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:50.214459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d384b46-83ad-40ba-a786-49a76f844bca admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:50.216181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4d384b46-83ad-40ba-a786-49a76f844bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:50.275296 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d384b46-83ad-40ba-a786-49a76f844bca admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:50.279024 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749d9dc-ebc9-4943-aa86-7c2c51add415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:50.279628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749d9dc-ebc9-4943-aa86-7c2c51add415 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:50.279907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749d9dc-ebc9-4943-aa86-7c2c51add415 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:50.280190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749d9dc-ebc9-4943-aa86-7c2c51add415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:50.336642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749d9dc-ebc9-4943-aa86-7c2c51add415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:50.338077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749d9dc-ebc9-4943-aa86-7c2c51add415 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:50.347512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1213/2432] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:51.841015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035356e-7cb1-4943-ab89-f5c81051078f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:51.842696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f035356e-7cb1-4943-ab89-f5c81051078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:51.855085 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035356e-7cb1-4943-ab89-f5c81051078f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:51.858708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e169f2-b24d-4396-8465-4e2ba7a88e6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:51.859551 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e169f2-b24d-4396-8465-4e2ba7a88e6e service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:51.859683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e169f2-b24d-4396-8465-4e2ba7a88e6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:51.859865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e169f2-b24d-4396-8465-4e2ba7a88e6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:51.919844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e169f2-b24d-4396-8465-4e2ba7a88e6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:51.921272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e169f2-b24d-4396-8465-4e2ba7a88e6e service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:51.931213 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1220/2433] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:52.559563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749d9dc-ebc9-4943-aa86-7c2c51add415 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:52.568212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749d9dc-ebc9-4943-aa86-7c2c51add415 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:52.571822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6f220-52f4-4501-b721-facb22f5648e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:52.572411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6f220-52f4-4501-b721-facb22f5648e service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:52.572691 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6f220-52f4-4501-b721-facb22f5648e service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:52.572962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6f220-52f4-4501-b721-facb22f5648e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:52.581911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6f220-52f4-4501-b721-facb22f5648e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:52.584032 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6f220-52f4-4501-b721-facb22f5648e service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:52.593358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1214/2434] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:54.602067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e169f2-b24d-4396-8465-4e2ba7a88e6e service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:54.603563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-89e169f2-b24d-4396-8465-4e2ba7a88e6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:54.675306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e169f2-b24d-4396-8465-4e2ba7a88e6e service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:54.679628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a72b0-74e1-403c-99e4-614f247dce24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:54.680257 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a72b0-74e1-403c-99e4-614f247dce24 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:54.680540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a72b0-74e1-403c-99e4-614f247dce24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:54.680814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a72b0-74e1-403c-99e4-614f247dce24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:54.682656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b65a72b0-74e1-403c-99e4-614f247dce24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:54.693790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a72b0-74e1-403c-99e4-614f247dce24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:54.695263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a72b0-74e1-403c-99e4-614f247dce24 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:54.704961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1221/2435] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:54.841068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce4871-0267-4e78-a0f6-d4666bd5841d None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:54.841575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce4871-0267-4e78-a0f6-d4666bd5841d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:54.841575 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce4871-0267-4e78-a0f6-d4666bd5841d None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:54.843464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1215/2436] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:27:54.850171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2efa1-753c-41ea-94f5-0a9f85c287d8 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:54.850380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a72b0-74e1-403c-99e4-614f247dce24 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:54.850476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2efa1-753c-41ea-94f5-0a9f85c287d8 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:54.850685 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2efa1-753c-41ea-94f5-0a9f85c287d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:54.860543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:54.876961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-98a2efa1-753c-41ea-94f5-0a9f85c287d8 None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:54.879281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-98a2efa1-753c-41ea-94f5-0a9f85c287d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:54.944487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a72b0-74e1-403c-99e4-614f247dce24 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:54.951924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b07e79-89a1-44a3-b2d6-b66dec33e56e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:54.952549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b07e79-89a1-44a3-b2d6-b66dec33e56e service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:54.952834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b07e79-89a1-44a3-b2d6-b66dec33e56e service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:54.953107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b07e79-89a1-44a3-b2d6-b66dec33e56e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:54.954962 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-36b07e79-89a1-44a3-b2d6-b66dec33e56e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:54.969387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b07e79-89a1-44a3-b2d6-b66dec33e56e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:54.971010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b07e79-89a1-44a3-b2d6-b66dec33e56e service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:54.977730 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1216/2437] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:27:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:27:54.984132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1222/2438] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:54.987072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2efa1-753c-41ea-94f5-0a9f85c287d8 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:54.988969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-98a2efa1-753c-41ea-94f5-0a9f85c287d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:55.061214 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2efa1-753c-41ea-94f5-0a9f85c287d8 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:55.064827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0aa5fe-5c11-4b0f-9f0d-5e05fbf39be8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23bb3a6586247e0a11ece33569d6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:55.065432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa5fe-5c11-4b0f-9f0d-5e05fbf39be8 service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:55.065710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa5fe-5c11-4b0f-9f0d-5e05fbf39be8 service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:55.065983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa5fe-5c11-4b0f-9f0d-5e05fbf39be8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:55.076851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0aa5fe-5c11-4b0f-9f0d-5e05fbf39be8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:55.078590 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0aa5fe-5c11-4b0f-9f0d-5e05fbf39be8 service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:55.093074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1217/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:27:55.167075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d880c-0619-49c1-8de6-e041d729d705 None None] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:55.167309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d880c-0619-49c1-8de6-e041d729d705 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:55.167587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d880c-0619-49c1-8de6-e041d729d705 None None] PATH_INFO: `/` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:55.168974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1223/2440] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:27:55.174427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32ecd5-6c3b-4fc3-b84f-359e3e38e7c1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:55.174780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32ecd5-6c3b-4fc3-b84f-359e3e38e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:55.175154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32ecd5-6c3b-4fc3-b84f-359e3e38e7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:55.199074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6e32ecd5-6c3b-4fc3-b84f-359e3e38e7c1 None None] MFA Rules not processed for user `a220cf4fafe84d6498bc959a9cd18df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:55.200269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6e32ecd5-6c3b-4fc3-b84f-359e3e38e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:55.207061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1218/2441] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:27:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:55.219572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d880c-0619-49c1-8de6-e041d729d705 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:55.221273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-da2d880c-0619-49c1-8de6-e041d729d705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:55.235208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d880c-0619-49c1-8de6-e041d729d705 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:55.238819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df04e8-d4cb-4d1b-8b7c-57fb0a7035ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:55.239416 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df04e8-d4cb-4d1b-8b7c-57fb0a7035ce service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:55.239691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df04e8-d4cb-4d1b-8b7c-57fb0a7035ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:55.239966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df04e8-d4cb-4d1b-8b7c-57fb0a7035ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:55.247276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df04e8-d4cb-4d1b-8b7c-57fb0a7035ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:55.248802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df04e8-d4cb-4d1b-8b7c-57fb0a7035ce service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:55.252988 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:55.257851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1224/2442] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:55.342571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f572101-7903-4f36-80ca-0cc3b6e48ce0 None None] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:55.342969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f572101-7903-4f36-80ca-0cc3b6e48ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:55.343254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f572101-7903-4f36-80ca-0cc3b6e48ce0 None None] PATH_INFO: `/` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:55.344550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1219/2443] 10.222.0.20 () {54 vars in 921 bytes} [Fri Aug 19 15:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 15:27:55.350655 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077f07e-f746-49ad-a79c-63ffaafcad7b None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:55.350946 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077f07e-f746-49ad-a79c-63ffaafcad7b None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:55.351224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077f07e-f746-49ad-a79c-63ffaafcad7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:55.370376 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8077f07e-f746-49ad-a79c-63ffaafcad7b None None] MFA Rules not processed for user `a86ca59cbf894c508b3439b08715da86`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:55.371659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8077f07e-f746-49ad-a79c-63ffaafcad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:55.382115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1225/2444] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Aug 19 15:27:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:55.394416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f572101-7903-4f36-80ca-0cc3b6e48ce0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:55.405991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f572101-7903-4f36-80ca-0cc3b6e48ce0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:55.409815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8efa7-2ed8-4129-9bcd-4b29c4e5bf53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:55.410549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8efa7-2ed8-4129-9bcd-4b29c4e5bf53 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:55.410894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8efa7-2ed8-4129-9bcd-4b29c4e5bf53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:55.411230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8efa7-2ed8-4129-9bcd-4b29c4e5bf53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:55.423536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8efa7-2ed8-4129-9bcd-4b29c4e5bf53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:55.425281 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8efa7-2ed8-4129-9bcd-4b29c4e5bf53 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:55.438019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1220/2445] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:56.521232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077f07e-f746-49ad-a79c-63ffaafcad7b None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:56.582905 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077f07e-f746-49ad-a79c-63ffaafcad7b None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:56.587387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:56.588043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:56.588325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:56.588598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] PATH_INFO: `/v3/users/9b72ac0fbb5e4cc39ad58dd0aeb18256` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:56.589788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b72ac0fbb5e4cc39ad58dd0aeb18256)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:56.591740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:56.637122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b72ac0fbb5e4cc39ad58dd0aeb18256'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:56.644595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b72ac0fbb5e4cc39ad58dd0aeb18256'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:56.656094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b72ac0fbb5e4cc39ad58dd0aeb18256'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:56.663314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b72ac0fbb5e4cc39ad58dd0aeb18256'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:56.663932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b72ac0fbb5e4cc39ad58dd0aeb18256'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:56.669819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1226/2446] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:27:56 2022] DELETE /identity/v3/users/9b72ac0fbb5e4cc39ad58dd0aeb18256 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:56.674889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c102c-2492-4b40-aec7-eeee8baa5f31 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:56.675342 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c102c-2492-4b40-aec7-eeee8baa5f31 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:56.675456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c102c-2492-4b40-aec7-eeee8baa5f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:56.694268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-316c102c-2492-4b40-aec7-eeee8baa5f31 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:56.695462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-316c102c-2492-4b40-aec7-eeee8baa5f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:56.754317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1221/2447] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:56.765116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:56.766627 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:56.838280 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96723ad-fd33-4cdb-935f-d2cb40415746 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:56.842015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9da81-19c9-42c7-b728-1f181539bf71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:56.842652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9da81-19c9-42c7-b728-1f181539bf71 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:56.842933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9da81-19c9-42c7-b728-1f181539bf71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:56.843204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9da81-19c9-42c7-b728-1f181539bf71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:56.852703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9da81-19c9-42c7-b728-1f181539bf71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:56.854397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9da81-19c9-42c7-b728-1f181539bf71 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:56.864967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1227/2448] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:27:57.251433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c102c-2492-4b40-aec7-eeee8baa5f31 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:57.252870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-316c102c-2492-4b40-aec7-eeee8baa5f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:57.265227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c102c-2492-4b40-aec7-eeee8baa5f31 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:57.270696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:57.271606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:57.272113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:57.272542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] PATH_INFO: `/v3/projects/d342015260994721b43c330d685724ae` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:57.274022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d342015260994721b43c330d685724ae)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:57.276627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:57.292725 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:57.351640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd342015260994721b43c330d685724ae', 'request_id': 'req-1369804c-e879-427e-a30f-26dc3b146feb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:57.405099 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd342015260994721b43c330d685724ae', 'request_id': 'req-1369804c-e879-427e-a30f-26dc3b146feb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:57.418227 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd342015260994721b43c330d685724ae', 'request_id': 'req-1369804c-e879-427e-a30f-26dc3b146feb'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:57.430580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] The token cache is being invalidate because project d342015260994721b43c330d685724ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:27:57.430873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:57.431536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:57.436399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1222/2449] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:27:57 2022] DELETE /identity/v3/projects/d342015260994721b43c330d685724ae => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:57.437542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9da81-19c9-42c7-b728-1f181539bf71 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:57.449758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9da81-19c9-42c7-b728-1f181539bf71 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:57.461514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:57.512369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:57.513585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:57.513879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:57.514225 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] PATH_INFO: `/v3/users/9b7a279eae224c38926c26639fa91e02` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:57.515390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7a279eae224c38926c26639fa91e02)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:57.517332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:57.573312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7a279eae224c38926c26639fa91e02'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:57.580991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7a279eae224c38926c26639fa91e02'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:57.594292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7a279eae224c38926c26639fa91e02'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:57.602259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7a279eae224c38926c26639fa91e02'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:57.602979 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7a279eae224c38926c26639fa91e02'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:57.609657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1228/2450] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:27:57 2022] DELETE /identity/v3/users/9b7a279eae224c38926c26639fa91e02 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:27:57.904267 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:57.905714 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:57.919962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369804c-e879-427e-a30f-26dc3b146feb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:57.978655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:57.979578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:57.979856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:57.980216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] PATH_INFO: `/v3/projects/38894b6a692c483cb378690cbba4da0f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:57.981344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38894b6a692c483cb378690cbba4da0f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:57.984286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:58.032080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38894b6a692c483cb378690cbba4da0f', 'request_id': 'req-10743e02-bf01-415d-ae91-f422e4b88236'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:58.040112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38894b6a692c483cb378690cbba4da0f', 'request_id': 'req-10743e02-bf01-415d-ae91-f422e4b88236'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:58.052205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38894b6a692c483cb378690cbba4da0f', 'request_id': 'req-10743e02-bf01-415d-ae91-f422e4b88236'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:58.070791 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] The token cache is being invalidate because project 38894b6a692c483cb378690cbba4da0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:27:58.071081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:58.071747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-10743e02-bf01-415d-ae91-f422e4b88236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:58.073237 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1223/2451] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:27:57 2022] DELETE /identity/v3/projects/38894b6a692c483cb378690cbba4da0f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:58.077301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:58.078775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:58.095098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418102a1-557e-49a5-8954-9fe061a22851 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:58.164818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:58.165471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:58.165751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:58.166084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] PATH_INFO: `/v3/users/bf6239085cd745edb9c400b8b8de743a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:58.167203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6239085cd745edb9c400b8b8de743a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:58.169692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:58.232267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:58.247943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6239085cd745edb9c400b8b8de743a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:58.260865 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6239085cd745edb9c400b8b8de743a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:58.289286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6239085cd745edb9c400b8b8de743a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:58.297486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6239085cd745edb9c400b8b8de743a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:58.298430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6239085cd745edb9c400b8b8de743a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:58.308575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1229/2452] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:27:58 2022] DELETE /identity/v3/users/bf6239085cd745edb9c400b8b8de743a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:58.715422 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9fd2-1357-4932-96e8-421cc049c0b7 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:58.715751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9fd2-1357-4932-96e8-421cc049c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:58.716642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f9fd2-1357-4932-96e8-421cc049c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:58.764509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:58.767212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:58.923078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ef6f9fd2-1357-4932-96e8-421cc049c0b7 None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:58.924931 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ef6f9fd2-1357-4932-96e8-421cc049c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:58.937998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8267ce1-1258-410a-b4e9-96e2a80db358 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:58.949751 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:58.950909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:58.951538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:58.951920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] PATH_INFO: `/v3/projects/2dd65ea7bfd84cecaeca5ea92db55652` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:58.954715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dd65ea7bfd84cecaeca5ea92db55652)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:58.957489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:58.980660 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:59.025202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1224/2453] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:27:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:59.040687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f9fd2-1357-4932-96e8-421cc049c0b7 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:59.042426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ef6f9fd2-1357-4932-96e8-421cc049c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:59.059329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dd65ea7bfd84cecaeca5ea92db55652', 'request_id': 'req-0831d635-6968-4b4f-99c3-e72dbaa90b5e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:59.071190 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dd65ea7bfd84cecaeca5ea92db55652', 'request_id': 'req-0831d635-6968-4b4f-99c3-e72dbaa90b5e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:59.081903 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dd65ea7bfd84cecaeca5ea92db55652', 'request_id': 'req-0831d635-6968-4b4f-99c3-e72dbaa90b5e'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:59.103386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] The token cache is being invalidate because project 2dd65ea7bfd84cecaeca5ea92db55652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:27:59.103754 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:59.104479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-0831d635-6968-4b4f-99c3-e72dbaa90b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:27:59.106203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1230/2454] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:27:58 2022] DELETE /identity/v3/projects/2dd65ea7bfd84cecaeca5ea92db55652 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:27:59.110770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3efb-7020-4383-8137-887ee6f04f88 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:59.111047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3efb-7020-4383-8137-887ee6f04f88 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:59.111314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3efb-7020-4383-8137-887ee6f04f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:59.131789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5c1f3efb-7020-4383-8137-887ee6f04f88 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:59.133006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f9fd2-1357-4932-96e8-421cc049c0b7 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:59.133130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5c1f3efb-7020-4383-8137-887ee6f04f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:59.177317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:59.200204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8e98-3217-4c59-b1c3-d28c0bb062d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:59.200814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8e98-3217-4c59-b1c3-d28c0bb062d1 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:59.201093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8e98-3217-4c59-b1c3-d28c0bb062d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:59.201364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e8e98-3217-4c59-b1c3-d28c0bb062d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:59.203130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1231/2455] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:27:59.203274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2f2e8e98-3217-4c59-b1c3-d28c0bb062d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:59.210553 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae5f0f-dd47-4ebb-b388-f27c9f5755ad None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:59.210839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae5f0f-dd47-4ebb-b388-f27c9f5755ad None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:59.211229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae5f0f-dd47-4ebb-b388-f27c9f5755ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:59.231262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-07ae5f0f-dd47-4ebb-b388-f27c9f5755ad None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:59.233010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-07ae5f0f-dd47-4ebb-b388-f27c9f5755ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:59.241357 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1232/2456] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:27:59.245490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae5f0f-dd47-4ebb-b388-f27c9f5755ad None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:59.254969 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae5f0f-dd47-4ebb-b388-f27c9f5755ad None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:59.259544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d77ce-2a87-4bd3-b8ff-1aaf49a9a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:59.260123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d77ce-2a87-4bd3-b8ff-1aaf49a9a1de admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:59.260396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d77ce-2a87-4bd3-b8ff-1aaf49a9a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:59.260664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d77ce-2a87-4bd3-b8ff-1aaf49a9a1de admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:59.261301 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d77ce-2a87-4bd3-b8ff-1aaf49a9a1de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:27:59.261595 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d77ce-2a87-4bd3-b8ff-1aaf49a9a1de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:59.263231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d77ce-2a87-4bd3-b8ff-1aaf49a9a1de admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:59.263358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e8e98-3217-4c59-b1c3-d28c0bb062d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:59.264871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e8e98-3217-4c59-b1c3-d28c0bb062d1 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:59.272884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1225/2457] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:27:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 15:27:59.278213 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1233/2458] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:27:59.280380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8e98-3217-4c59-b1c3-d28c0bb062d1 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:59.290887 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e8e98-3217-4c59-b1c3-d28c0bb062d1 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:59.296540 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26146ed0-356a-472d-a0a2-a2160df0fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:59.297140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26146ed0-356a-472d-a0a2-a2160df0fe36 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:59.297437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26146ed0-356a-472d-a0a2-a2160df0fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:59.297704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26146ed0-356a-472d-a0a2-a2160df0fe36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:59.298966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26146ed0-356a-472d-a0a2-a2160df0fe36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:59.300496 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26146ed0-356a-472d-a0a2-a2160df0fe36 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:59.335643 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:27:59.349207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1226/2459] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:27:59 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:27:59.350649 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d77ce-2a87-4bd3-b8ff-1aaf49a9a1de admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:59.367890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d77ce-2a87-4bd3-b8ff-1aaf49a9a1de admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:59.453433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f17e9-6835-44b0-b47c-90d6627bcf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:59.454078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f17e9-6835-44b0-b47c-90d6627bcf14 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:59.454614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f17e9-6835-44b0-b47c-90d6627bcf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:59.454776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f17e9-6835-44b0-b47c-90d6627bcf14 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:59.456430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f17e9-6835-44b0-b47c-90d6627bcf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:59.459041 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f17e9-6835-44b0-b47c-90d6627bcf14 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:59.494171 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1234/2460] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:27:59 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:27:59.498383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26146ed0-356a-472d-a0a2-a2160df0fe36 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:59.517243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26146ed0-356a-472d-a0a2-a2160df0fe36 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:59.524274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d0cce-ad94-4f5e-83d3-a6fe64d28392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:59.525136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d0cce-ad94-4f5e-83d3-a6fe64d28392 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:59.525625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d0cce-ad94-4f5e-83d3-a6fe64d28392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:59.526247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d0cce-ad94-4f5e-83d3-a6fe64d28392 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:59.527075 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d0cce-ad94-4f5e-83d3-a6fe64d28392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:59.529781 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d0cce-ad94-4f5e-83d3-a6fe64d28392 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:59.543686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1227/2461] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:59.548162 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f17e9-6835-44b0-b47c-90d6627bcf14 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:59.564079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f17e9-6835-44b0-b47c-90d6627bcf14 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:59.568756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0c592-dcf1-49c0-8043-233dd2a5f7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:59.569361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c592-dcf1-49c0-8043-233dd2a5f7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:59.569673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c592-dcf1-49c0-8043-233dd2a5f7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:59.569948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c592-dcf1-49c0-8043-233dd2a5f7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:59.570618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0c592-dcf1-49c0-8043-233dd2a5f7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:59.572219 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0c592-dcf1-49c0-8043-233dd2a5f7e2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:59.584522 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1235/2462] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:27:59.588845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d0cce-ad94-4f5e-83d3-a6fe64d28392 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:59.599426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d0cce-ad94-4f5e-83d3-a6fe64d28392 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:59.603967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a489c4-6f69-4888-85e7-3750383c6b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:59.604617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a489c4-6f69-4888-85e7-3750383c6b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:59.604895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a489c4-6f69-4888-85e7-3750383c6b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:59.605167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a489c4-6f69-4888-85e7-3750383c6b4e admin admin] PATH_INFO: `/v3/projects/2f2e4c3158d84e55942e29a4a941d38f/users/2e1d2a012c1643bc8b4beefc8ea69ceb/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:59.619581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a489c4-6f69-4888-85e7-3750383c6b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2e4c3158d84e55942e29a4a941d38f, user_id=2e1d2a012c1643bc8b4beefc8ea69ceb, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:59.622758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a489c4-6f69-4888-85e7-3750383c6b4e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:59.635442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1228/2463] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:27:59 2022] PUT /identity/v3/projects/2f2e4c3158d84e55942e29a4a941d38f/users/2e1d2a012c1643bc8b4beefc8ea69ceb/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:27:59.646375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cedddb-5d1e-4543-aa55-9137099a028f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:59.646741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cedddb-5d1e-4543-aa55-9137099a028f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:59.647111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cedddb-5d1e-4543-aa55-9137099a028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:59.675743 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-41cedddb-5d1e-4543-aa55-9137099a028f None None] MFA Rules not processed for user `2e1d2a012c1643bc8b4beefc8ea69ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:27:59.676964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-41cedddb-5d1e-4543-aa55-9137099a028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:59.741650 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1236/2464] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:27:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:27:59.753904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a489c4-6f69-4888-85e7-3750383c6b4e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:27:59.757087 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f3a489c4-6f69-4888-85e7-3750383c6b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:27:59.875319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a489c4-6f69-4888-85e7-3750383c6b4e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:27:59.879086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d09024-179a-4992-ae3c-e39efeabb195 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23bb3a6586247e0a11ece33569d6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:27:59.879756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d09024-179a-4992-ae3c-e39efeabb195 service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:27:59.879969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d09024-179a-4992-ae3c-e39efeabb195 service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:27:59.880240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d09024-179a-4992-ae3c-e39efeabb195 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:27:59.895760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d09024-179a-4992-ae3c-e39efeabb195 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:27:59.897154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d09024-179a-4992-ae3c-e39efeabb195 service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:27:59.924957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1229/2465] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:27:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:09.738604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:09.905256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:16.180413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd972ef8-ff52-4c55-9843-a379f9d96621 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:16.180906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd972ef8-ff52-4c55-9843-a379f9d96621 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:16.181029 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd972ef8-ff52-4c55-9843-a379f9d96621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:16.200760 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-dd972ef8-ff52-4c55-9843-a379f9d96621 None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:16.202047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dd972ef8-ff52-4c55-9843-a379f9d96621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:16.259916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1237/2466] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 19 15:28:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:16.274315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d09024-179a-4992-ae3c-e39efeabb195 service glance] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:16.275756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-05d09024-179a-4992-ae3c-e39efeabb195 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:16.349893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d09024-179a-4992-ae3c-e39efeabb195 service glance] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:16.354910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98afc5-714b-4254-b696-1b02828aecd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:16.355512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98afc5-714b-4254-b696-1b02828aecd1 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:16.355791 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98afc5-714b-4254-b696-1b02828aecd1 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:16.356089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98afc5-714b-4254-b696-1b02828aecd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:16.364015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98afc5-714b-4254-b696-1b02828aecd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:16.365577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98afc5-714b-4254-b696-1b02828aecd1 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:16.373961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1230/2467] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:28:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:28:17.032310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd972ef8-ff52-4c55-9843-a379f9d96621 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:17.033750 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dd972ef8-ff52-4c55-9843-a379f9d96621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:17.120939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd972ef8-ff52-4c55-9843-a379f9d96621 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:17.127882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68e62-63f3-4fd5-b499-6edc5396b219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:17.127882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68e62-63f3-4fd5-b499-6edc5396b219 service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:17.128186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68e62-63f3-4fd5-b499-6edc5396b219 service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:17.128381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68e62-63f3-4fd5-b499-6edc5396b219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:17.130364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d8f68e62-63f3-4fd5-b499-6edc5396b219 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:17.197066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68e62-63f3-4fd5-b499-6edc5396b219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:17.198722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68e62-63f3-4fd5-b499-6edc5396b219 service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:17.208097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1238/2468] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:18.068959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98afc5-714b-4254-b696-1b02828aecd1 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:18.070633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ec98afc5-714b-4254-b696-1b02828aecd1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:18.089361 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98afc5-714b-4254-b696-1b02828aecd1 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:18.095799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea6afd-ae0c-4bb0-992c-4984e2a5a5d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:18.096661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea6afd-ae0c-4bb0-992c-4984e2a5a5d4 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:18.097011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea6afd-ae0c-4bb0-992c-4984e2a5a5d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:18.097284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea6afd-ae0c-4bb0-992c-4984e2a5a5d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:18.099231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-09ea6afd-ae0c-4bb0-992c-4984e2a5a5d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:18.113991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea6afd-ae0c-4bb0-992c-4984e2a5a5d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:18.115787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea6afd-ae0c-4bb0-992c-4984e2a5a5d4 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:18.135595 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1231/2469] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:22.973894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68e62-63f3-4fd5-b499-6edc5396b219 service nova] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:23.018802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=100 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:23.037911 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68e62-63f3-4fd5-b499-6edc5396b219 service nova] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:23.042496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:23.043129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:23.043409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:23.043681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] PATH_INFO: `/v3/users/2e1d2a012c1643bc8b4beefc8ea69ceb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:23.044804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1d2a012c1643bc8b4beefc8ea69ceb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:23.046756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:23.098513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1d2a012c1643bc8b4beefc8ea69ceb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:23.106105 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1d2a012c1643bc8b4beefc8ea69ceb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:23.121314 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1d2a012c1643bc8b4beefc8ea69ceb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:23.129700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1d2a012c1643bc8b4beefc8ea69ceb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:23.130418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1d2a012c1643bc8b4beefc8ea69ceb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:23.136474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1239/2470] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:22 2022] DELETE /identity/v3/users/2e1d2a012c1643bc8b4beefc8ea69ceb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:23.141552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c761d1-383c-42d5-95b7-5a6bd4a0e601 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:23.141943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c761d1-383c-42d5-95b7-5a6bd4a0e601 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:23.142124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c761d1-383c-42d5-95b7-5a6bd4a0e601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:23.160708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e6c761d1-383c-42d5-95b7-5a6bd4a0e601 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:23.161904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e6c761d1-383c-42d5-95b7-5a6bd4a0e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:23.224071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1232/2471] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:23.237043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:23.238601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:23.308524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53437d6-394f-4a1a-b306-2e8f3c2f3fa3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:23.313367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0243c85-a802-4b78-a339-be6ccc30184d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:23.313993 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243c85-a802-4b78-a339-be6ccc30184d service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:23.314482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243c85-a802-4b78-a339-be6ccc30184d service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:23.314900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243c85-a802-4b78-a339-be6ccc30184d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:23.325702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0243c85-a802-4b78-a339-be6ccc30184d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:23.327290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0243c85-a802-4b78-a339-be6ccc30184d service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:23.338000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1240/2472] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:23.642240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c761d1-383c-42d5-95b7-5a6bd4a0e601 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:23.643953 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e6c761d1-383c-42d5-95b7-5a6bd4a0e601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:23.660396 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c761d1-383c-42d5-95b7-5a6bd4a0e601 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:23.665430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:23.666107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:23.666384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:23.666655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] PATH_INFO: `/v3/projects/2f2e4c3158d84e55942e29a4a941d38f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:23.667837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f2e4c3158d84e55942e29a4a941d38f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:23.670325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:23.719863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f2e4c3158d84e55942e29a4a941d38f', 'request_id': 'req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:23.725649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f2e4c3158d84e55942e29a4a941d38f', 'request_id': 'req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:23.733604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f2e4c3158d84e55942e29a4a941d38f', 'request_id': 'req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:23.741759 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:23.746407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] The token cache is being invalidate because project 2f2e4c3158d84e55942e29a4a941d38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:23.747004 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:23.747814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:23.749438 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1233/2473] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:23 2022] DELETE /identity/v3/projects/2f2e4c3158d84e55942e29a4a941d38f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:23.754520 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d82c6-bcdd-40e1-a8dc-79cbd5565e72 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:23.754917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d82c6-bcdd-40e1-a8dc-79cbd5565e72 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:23.755190 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d82c6-bcdd-40e1-a8dc-79cbd5565e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:23.773917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-534d82c6-bcdd-40e1-a8dc-79cbd5565e72 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:23.775131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-534d82c6-bcdd-40e1-a8dc-79cbd5565e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:23.839256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1241/2474] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:23.900914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:23.902598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:23.904216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cc9d3-5e78-4818-9efb-325cbda83e98 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:23.904504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cc9d3-5e78-4818-9efb-325cbda83e98 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:23.904775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cc9d3-5e78-4818-9efb-325cbda83e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:23.913323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:23.925651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3d5cc9d3-5e78-4818-9efb-325cbda83e98 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:23.927318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3d5cc9d3-5e78-4818-9efb-325cbda83e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:23.935303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1242/2475] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:23.939451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cc9d3-5e78-4818-9efb-325cbda83e98 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:23.948600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cc9d3-5e78-4818-9efb-325cbda83e98 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:23.954323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec42fd-ec5e-4708-84a0-ab1de7be4fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:23.955186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec42fd-ec5e-4708-84a0-ab1de7be4fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:23.955594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec42fd-ec5e-4708-84a0-ab1de7be4fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:23.955987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec42fd-ec5e-4708-84a0-ab1de7be4fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:23.956689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec42fd-ec5e-4708-84a0-ab1de7be4fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:23.956984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec42fd-ec5e-4708-84a0-ab1de7be4fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:23.958625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec42fd-ec5e-4708-84a0-ab1de7be4fd6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:23.967320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9bd5b-c84c-4422-8422-c53b24ce51e7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:23.970875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22856768-e761-4bb7-b80a-e2afbe9657fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:23.971009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1243/2476] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:28:23.971735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22856768-e761-4bb7-b80a-e2afbe9657fc service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:23.972019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22856768-e761-4bb7-b80a-e2afbe9657fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:23.972288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22856768-e761-4bb7-b80a-e2afbe9657fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:23.974006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-22856768-e761-4bb7-b80a-e2afbe9657fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:23.975683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec42fd-ec5e-4708-84a0-ab1de7be4fd6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:23.985368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec42fd-ec5e-4708-84a0-ab1de7be4fd6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:23.986008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22856768-e761-4bb7-b80a-e2afbe9657fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:23.987502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22856768-e761-4bb7-b80a-e2afbe9657fc service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:23.990122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4501c-6514-474d-a3e8-3326cc0c21f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:23.990702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4501c-6514-474d-a3e8-3326cc0c21f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:23.990983 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4501c-6514-474d-a3e8-3326cc0c21f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:23.991247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4501c-6514-474d-a3e8-3326cc0c21f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:23.991859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4501c-6514-474d-a3e8-3326cc0c21f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:23.993728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4501c-6514-474d-a3e8-3326cc0c21f9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:23.997638 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1234/2477] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:24.021659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1244/2478] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:23 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:24.025561 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22856768-e761-4bb7-b80a-e2afbe9657fc service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:24.035828 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22856768-e761-4bb7-b80a-e2afbe9657fc service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:24.093287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78471dd8-af8d-456d-ab20-a7c2c6fa0053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:24.093891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78471dd8-af8d-456d-ab20-a7c2c6fa0053 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:24.094192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78471dd8-af8d-456d-ab20-a7c2c6fa0053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:24.094464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78471dd8-af8d-456d-ab20-a7c2c6fa0053 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:24.095090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78471dd8-af8d-456d-ab20-a7c2c6fa0053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:24.097589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78471dd8-af8d-456d-ab20-a7c2c6fa0053 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:24.121457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1235/2479] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:24 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:24.122778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4501c-6514-474d-a3e8-3326cc0c21f9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:24.133613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4501c-6514-474d-a3e8-3326cc0c21f9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:24.139036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f1399-9257-46eb-8c97-f4971552095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:24.139735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1399-9257-46eb-8c97-f4971552095d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:24.140180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1399-9257-46eb-8c97-f4971552095d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:24.140407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1399-9257-46eb-8c97-f4971552095d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:24.141066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f1399-9257-46eb-8c97-f4971552095d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:24.142892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f1399-9257-46eb-8c97-f4971552095d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:24.156828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1245/2480] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:24.158166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78471dd8-af8d-456d-ab20-a7c2c6fa0053 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:24.168190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78471dd8-af8d-456d-ab20-a7c2c6fa0053 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:24.172794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82141eb-35c7-4bcd-81f3-be62d1517032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:24.173388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82141eb-35c7-4bcd-81f3-be62d1517032 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:24.173667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82141eb-35c7-4bcd-81f3-be62d1517032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:24.173941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82141eb-35c7-4bcd-81f3-be62d1517032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:24.174621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82141eb-35c7-4bcd-81f3-be62d1517032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:24.176240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82141eb-35c7-4bcd-81f3-be62d1517032 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:24.186232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1236/2481] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:24.190125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f1399-9257-46eb-8c97-f4971552095d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:24.200584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f1399-9257-46eb-8c97-f4971552095d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:24.205129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e90ed3-7663-4944-8e99-c1c82e2be434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:24.205772 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e90ed3-7663-4944-8e99-c1c82e2be434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:24.206095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e90ed3-7663-4944-8e99-c1c82e2be434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:24.206398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e90ed3-7663-4944-8e99-c1c82e2be434 admin admin] PATH_INFO: `/v3/projects/e6841711cbfd4b83ac7decb6b3e9e794/users/b3026bdc47b74e86aa0abce7ac709602/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:24.222186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e90ed3-7663-4944-8e99-c1c82e2be434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6841711cbfd4b83ac7decb6b3e9e794, user_id=b3026bdc47b74e86aa0abce7ac709602, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:24.224811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e90ed3-7663-4944-8e99-c1c82e2be434 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:24.238364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1246/2482] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:24 2022] PUT /identity/v3/projects/e6841711cbfd4b83ac7decb6b3e9e794/users/b3026bdc47b74e86aa0abce7ac709602/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:24.248363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c7d40-7c96-4f5c-9b70-aae6e0ba813e None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:24.248539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c7d40-7c96-4f5c-9b70-aae6e0ba813e None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:24.248818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c7d40-7c96-4f5c-9b70-aae6e0ba813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:24.282186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5f8c7d40-7c96-4f5c-9b70-aae6e0ba813e None None] MFA Rules not processed for user `b3026bdc47b74e86aa0abce7ac709602`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:24.283417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5f8c7d40-7c96-4f5c-9b70-aae6e0ba813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:24.349223 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1237/2483] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:24.360649 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e90ed3-7663-4944-8e99-c1c82e2be434 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:24.362414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e2e90ed3-7663-4944-8e99-c1c82e2be434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:24.419352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e90ed3-7663-4944-8e99-c1c82e2be434 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:24.423067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d2a5a-a289-4df9-b667-ee50de8e31bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:24.423670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d2a5a-a289-4df9-b667-ee50de8e31bf service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:24.423949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d2a5a-a289-4df9-b667-ee50de8e31bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:24.424222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d2a5a-a289-4df9-b667-ee50de8e31bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:24.432525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d2a5a-a289-4df9-b667-ee50de8e31bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:24.433953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d2a5a-a289-4df9-b667-ee50de8e31bf service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:24.443423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1247/2484] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:27.290270 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c7d40-7c96-4f5c-9b70-aae6e0ba813e None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:27.291892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5f8c7d40-7c96-4f5c-9b70-aae6e0ba813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:27.329498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:27.371215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d2a5a-a289-4df9-b667-ee50de8e31bf service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:27.373257 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f51d2a5a-a289-4df9-b667-ee50de8e31bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:27.413374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c7d40-7c96-4f5c-9b70-aae6e0ba813e None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:27.419189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f01dc5-6a9d-4aa2-990c-a08206ddcf6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2862a661174142d69bbdd54ee0289681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:27.419804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f01dc5-6a9d-4aa2-990c-a08206ddcf6c service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:27.420083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f01dc5-6a9d-4aa2-990c-a08206ddcf6c service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:27.420363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f01dc5-6a9d-4aa2-990c-a08206ddcf6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:27.422325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f9f01dc5-6a9d-4aa2-990c-a08206ddcf6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:27.435624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f01dc5-6a9d-4aa2-990c-a08206ddcf6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:27.437293 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f01dc5-6a9d-4aa2-990c-a08206ddcf6c service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:27.448066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1238/2485] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:28:27.486560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d2a5a-a289-4df9-b667-ee50de8e31bf service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:27.494345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ee3d2-4228-4252-819d-ffae86824e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:27.495010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ee3d2-4228-4252-819d-ffae86824e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:27.495432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ee3d2-4228-4252-819d-ffae86824e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:27.495747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ee3d2-4228-4252-819d-ffae86824e50 admin admin] PATH_INFO: `/v3/users/a684c639db1f44488d1b05ee55014c71` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:27.497504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ee3d2-4228-4252-819d-ffae86824e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a684c639db1f44488d1b05ee55014c71)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:27.499635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ee3d2-4228-4252-819d-ffae86824e50 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:27.543776 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:27.562736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d01ee3d2-4228-4252-819d-ffae86824e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a684c639db1f44488d1b05ee55014c71'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:27.571785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d01ee3d2-4228-4252-819d-ffae86824e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a684c639db1f44488d1b05ee55014c71'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:27.604831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d01ee3d2-4228-4252-819d-ffae86824e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a684c639db1f44488d1b05ee55014c71'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:27.609766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d01ee3d2-4228-4252-819d-ffae86824e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a684c639db1f44488d1b05ee55014c71'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:27.611302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-d01ee3d2-4228-4252-819d-ffae86824e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a684c639db1f44488d1b05ee55014c71'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:27.619987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1248/2486] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:27 2022] DELETE /identity/v3/users/a684c639db1f44488d1b05ee55014c71 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:27.822552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f01dc5-6a9d-4aa2-990c-a08206ddcf6c service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:27.836519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f01dc5-6a9d-4aa2-990c-a08206ddcf6c service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:27.901569 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:27.902316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:27.902627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:27.903451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] PATH_INFO: `/v3/projects/dc28ed60ca8e4c30b48bdfa2af132810` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:27.904621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc28ed60ca8e4c30b48bdfa2af132810)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:27.907134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:27.957439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc28ed60ca8e4c30b48bdfa2af132810', 'request_id': 'req-05133f36-95d8-41c9-86d7-b51a86c3161e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:27.962787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc28ed60ca8e4c30b48bdfa2af132810', 'request_id': 'req-05133f36-95d8-41c9-86d7-b51a86c3161e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:27.970855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc28ed60ca8e4c30b48bdfa2af132810', 'request_id': 'req-05133f36-95d8-41c9-86d7-b51a86c3161e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:27.982093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] The token cache is being invalidate because project dc28ed60ca8e4c30b48bdfa2af132810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:27.982380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:27.983007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-05133f36-95d8-41c9-86d7-b51a86c3161e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:27.984487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1239/2487] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:27 2022] DELETE /identity/v3/projects/dc28ed60ca8e4c30b48bdfa2af132810 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:28:27.989326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18a1d-b018-4ed2-8971-fae226b3a89a None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:27.989552 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18a1d-b018-4ed2-8971-fae226b3a89a None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:27.989825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a18a1d-b018-4ed2-8971-fae226b3a89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.015238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f6a18a1d-b018-4ed2-8971-fae226b3a89a None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:28.016639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f6a18a1d-b018-4ed2-8971-fae226b3a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:28.075554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1249/2488] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:28.083358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c63848-de37-4df6-a417-3b1e4350d2cf None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.083640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c63848-de37-4df6-a417-3b1e4350d2cf None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.083911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c63848-de37-4df6-a417-3b1e4350d2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.103058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-f1c63848-de37-4df6-a417-3b1e4350d2cf None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:28.104255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f1c63848-de37-4df6-a417-3b1e4350d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:28.112045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1240/2489] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:28.116180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18a1d-b018-4ed2-8971-fae226b3a89a None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.126302 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a18a1d-b018-4ed2-8971-fae226b3a89a None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.131031 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d512d4-3348-4792-bb58-ba19c530ef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.131626 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d512d4-3348-4792-bb58-ba19c530ef7e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.131902 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d512d4-3348-4792-bb58-ba19c530ef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.132191 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d512d4-3348-4792-bb58-ba19c530ef7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.132830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d512d4-3348-4792-bb58-ba19c530ef7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:28.133136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d512d4-3348-4792-bb58-ba19c530ef7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:28.134759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d512d4-3348-4792-bb58-ba19c530ef7e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:28.146541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1250/2490] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:28:28.150780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c63848-de37-4df6-a417-3b1e4350d2cf None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.159808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c63848-de37-4df6-a417-3b1e4350d2cf None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.164355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5591637-04ff-42ea-a44b-2b31e476effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.164938 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5591637-04ff-42ea-a44b-2b31e476effa admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.165222 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5591637-04ff-42ea-a44b-2b31e476effa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.165492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5591637-04ff-42ea-a44b-2b31e476effa admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.166148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5591637-04ff-42ea-a44b-2b31e476effa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:28.168013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5591637-04ff-42ea-a44b-2b31e476effa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:28.194296 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1241/2491] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:28 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:28.198430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d512d4-3348-4792-bb58-ba19c530ef7e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.208640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d512d4-3348-4792-bb58-ba19c530ef7e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.264033 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a9a15-ea9b-495e-8407-99a81bcf3ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.264633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a9a15-ea9b-495e-8407-99a81bcf3ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.264911 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a9a15-ea9b-495e-8407-99a81bcf3ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.265216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a9a15-ea9b-495e-8407-99a81bcf3ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.265845 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a9a15-ea9b-495e-8407-99a81bcf3ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:28.267958 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a9a15-ea9b-495e-8407-99a81bcf3ba2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:28.288247 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1251/2492] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:28 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:28.292145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5591637-04ff-42ea-a44b-2b31e476effa admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.297832 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:28.304503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5591637-04ff-42ea-a44b-2b31e476effa admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.312394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80ba82-3bd1-4591-b386-330baa9e33b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.313144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ba82-3bd1-4591-b386-330baa9e33b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.313543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ba82-3bd1-4591-b386-330baa9e33b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.313883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80ba82-3bd1-4591-b386-330baa9e33b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.314632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80ba82-3bd1-4591-b386-330baa9e33b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:28.316318 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80ba82-3bd1-4591-b386-330baa9e33b9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:28.333102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1242/2493] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:28.334323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a9a15-ea9b-495e-8407-99a81bcf3ba2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.344579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a9a15-ea9b-495e-8407-99a81bcf3ba2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.349955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76f254-0afa-4447-b6e1-d37a15b2c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.350593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f254-0afa-4447-b6e1-d37a15b2c55d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.350879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f254-0afa-4447-b6e1-d37a15b2c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.351153 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f254-0afa-4447-b6e1-d37a15b2c55d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.351792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76f254-0afa-4447-b6e1-d37a15b2c55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:28.353410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76f254-0afa-4447-b6e1-d37a15b2c55d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:28.364978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1252/2494] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:28.369078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80ba82-3bd1-4591-b386-330baa9e33b9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.379552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80ba82-3bd1-4591-b386-330baa9e33b9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.385616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60337a5-0968-4638-8050-59685b3f0637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.386434 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60337a5-0968-4638-8050-59685b3f0637 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.386814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60337a5-0968-4638-8050-59685b3f0637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.387889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60337a5-0968-4638-8050-59685b3f0637 admin admin] PATH_INFO: `/v3/projects/3da635d7b43f42c4a541465b76b58b2d/users/f10dea50a913422b83301c87133e811c/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.403831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60337a5-0968-4638-8050-59685b3f0637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da635d7b43f42c4a541465b76b58b2d, user_id=f10dea50a913422b83301c87133e811c, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:28.406687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60337a5-0968-4638-8050-59685b3f0637 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:28.422097 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1243/2495] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:28 2022] PUT /identity/v3/projects/3da635d7b43f42c4a541465b76b58b2d/users/f10dea50a913422b83301c87133e811c/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:28.435448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65f79-e4b2-4f4c-af57-df82fa94d5fc None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.435919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65f79-e4b2-4f4c-af57-df82fa94d5fc None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.436013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa65f79-e4b2-4f4c-af57-df82fa94d5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.462646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-baa65f79-e4b2-4f4c-af57-df82fa94d5fc None None] MFA Rules not processed for user `f10dea50a913422b83301c87133e811c`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:28.463859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-baa65f79-e4b2-4f4c-af57-df82fa94d5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:28.468019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:28.556475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1253/2496] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:28 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:28.561417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60337a5-0968-4638-8050-59685b3f0637 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.624338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60337a5-0968-4638-8050-59685b3f0637 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.629195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc8c03-9962-4eb0-9e44-5d92014ded4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.629794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc8c03-9962-4eb0-9e44-5d92014ded4e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.630092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc8c03-9962-4eb0-9e44-5d92014ded4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.630364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc8c03-9962-4eb0-9e44-5d92014ded4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.630993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc8c03-9962-4eb0-9e44-5d92014ded4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:28.632867 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc8c03-9962-4eb0-9e44-5d92014ded4e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:28.660416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1244/2497] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:28 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:28.664834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa65f79-e4b2-4f4c-af57-df82fa94d5fc None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.676214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa65f79-e4b2-4f4c-af57-df82fa94d5fc None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.733511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f378fcd-bf02-4f1e-a13d-b2bdda14a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.734161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378fcd-bf02-4f1e-a13d-b2bdda14a358 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.734445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378fcd-bf02-4f1e-a13d-b2bdda14a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.734716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f378fcd-bf02-4f1e-a13d-b2bdda14a358 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.735381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f378fcd-bf02-4f1e-a13d-b2bdda14a358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:28.737344 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f378fcd-bf02-4f1e-a13d-b2bdda14a358 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:28.762518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1254/2498] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:28 2022] POST /identity/v3/users => generated 309 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:28.768694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc8c03-9962-4eb0-9e44-5d92014ded4e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.778741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc8c03-9962-4eb0-9e44-5d92014ded4e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.787353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecce24-fad1-44c4-9911-b3a1e2530342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.788065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecce24-fad1-44c4-9911-b3a1e2530342 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.788245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecce24-fad1-44c4-9911-b3a1e2530342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.788508 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecce24-fad1-44c4-9911-b3a1e2530342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.789287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecce24-fad1-44c4-9911-b3a1e2530342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:28.790739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecce24-fad1-44c4-9911-b3a1e2530342 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:28.804634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1245/2499] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:28.808508 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f378fcd-bf02-4f1e-a13d-b2bdda14a358 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.819827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f378fcd-bf02-4f1e-a13d-b2bdda14a358 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.825562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4282-ba5a-4752-9046-826aa010f28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.826457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4282-ba5a-4752-9046-826aa010f28d admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.826775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4282-ba5a-4752-9046-826aa010f28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.827134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c4282-ba5a-4752-9046-826aa010f28d admin admin] PATH_INFO: `/v3/projects/00673da0ff804cf38f7b022df93e18a7/users/b0a94cc49df84337813314f352782b6a/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.844807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4282-ba5a-4752-9046-826aa010f28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00673da0ff804cf38f7b022df93e18a7, user_id=b0a94cc49df84337813314f352782b6a, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:28.848304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c4282-ba5a-4752-9046-826aa010f28d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:28.864868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1255/2500] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:28 2022] PUT /identity/v3/projects/00673da0ff804cf38f7b022df93e18a7/users/b0a94cc49df84337813314f352782b6a/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:28.869380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecce24-fad1-44c4-9911-b3a1e2530342 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.885253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecce24-fad1-44c4-9911-b3a1e2530342 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.960753 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71fd0a-8700-4c4b-8c84-ceb67ea26e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.961541 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71fd0a-8700-4c4b-8c84-ceb67ea26e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.961884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71fd0a-8700-4c4b-8c84-ceb67ea26e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.962255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71fd0a-8700-4c4b-8c84-ceb67ea26e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:28.962966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71fd0a-8700-4c4b-8c84-ceb67ea26e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:28.964553 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71fd0a-8700-4c4b-8c84-ceb67ea26e24 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:28.976146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1246/2501] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:28.980110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4282-ba5a-4752-9046-826aa010f28d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:28.991254 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c4282-ba5a-4752-9046-826aa010f28d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:28.996777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a5c86-a131-4fa3-a6f7-aeab44912c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:28.997440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5c86-a131-4fa3-a6f7-aeab44912c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:28.997793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5c86-a131-4fa3-a6f7-aeab44912c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:28.998107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a5c86-a131-4fa3-a6f7-aeab44912c12 admin admin] PATH_INFO: `/v3/projects/00673da0ff804cf38f7b022df93e18a7/users/b0a94cc49df84337813314f352782b6a/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:29.000392 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a5c86-a131-4fa3-a6f7-aeab44912c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00673da0ff804cf38f7b022df93e18a7, user_id=b0a94cc49df84337813314f352782b6a, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:29.002950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a5c86-a131-4fa3-a6f7-aeab44912c12 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:29.024996 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1256/2502] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:28 2022] PUT /identity/v3/projects/00673da0ff804cf38f7b022df93e18a7/users/b0a94cc49df84337813314f352782b6a/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:29.026609 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1400f8-cd03-48ad-8d24-c1cd906f7ace None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:29.026893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1400f8-cd03-48ad-8d24-c1cd906f7ace None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:29.027193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1400f8-cd03-48ad-8d24-c1cd906f7ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:29.056484 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7c1400f8-cd03-48ad-8d24-c1cd906f7ace None None] MFA Rules not processed for user `b0a94cc49df84337813314f352782b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:29.057711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7c1400f8-cd03-48ad-8d24-c1cd906f7ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:29.088135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:29.134202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1247/2503] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:29.145603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a5c86-a131-4fa3-a6f7-aeab44912c12 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:29.147363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e93a5c86-a131-4fa3-a6f7-aeab44912c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:29.208270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a5c86-a131-4fa3-a6f7-aeab44912c12 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:29.212077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a807cb-780a-42f9-bc21-628e25eec65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:29.212681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a807cb-780a-42f9-bc21-628e25eec65e service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:29.212962 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a807cb-780a-42f9-bc21-628e25eec65e service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:29.213235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a807cb-780a-42f9-bc21-628e25eec65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:29.223110 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a807cb-780a-42f9-bc21-628e25eec65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:29.224771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a807cb-780a-42f9-bc21-628e25eec65e service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:29.229827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:29.235026 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1257/2504] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:29 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:29.388266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1400f8-cd03-48ad-8d24-c1cd906f7ace None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:29.452956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1400f8-cd03-48ad-8d24-c1cd906f7ace None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:29.457819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:29.458482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:29.458833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:29.459275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] PATH_INFO: `/v3/users/f10dea50a913422b83301c87133e811c` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:29.461365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10dea50a913422b83301c87133e811c)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:29.463290 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:29.507983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10dea50a913422b83301c87133e811c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:29.508630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10dea50a913422b83301c87133e811c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:29.509238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10dea50a913422b83301c87133e811c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:29.517017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10dea50a913422b83301c87133e811c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:29.524710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10dea50a913422b83301c87133e811c'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:29.542498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1248/2505] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:29 2022] DELETE /identity/v3/users/f10dea50a913422b83301c87133e811c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:29.546870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849a919-bb39-4ee8-a764-f4faff03a151 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:29.547366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849a919-bb39-4ee8-a764-f4faff03a151 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:29.547473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849a919-bb39-4ee8-a764-f4faff03a151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:29.566463 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7849a919-bb39-4ee8-a764-f4faff03a151 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:29.567671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7849a919-bb39-4ee8-a764-f4faff03a151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:29.625603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1258/2506] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:29.635671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:29.637108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:29.682528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:29.696021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a63815-b036-438c-bff1-1dd63366c243 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:29.700157 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf6eac-f8b7-4fcf-9591-8cf5f7bd3b15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:29.700754 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf6eac-f8b7-4fcf-9591-8cf5f7bd3b15 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:29.701029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf6eac-f8b7-4fcf-9591-8cf5f7bd3b15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:29.701292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf6eac-f8b7-4fcf-9591-8cf5f7bd3b15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:29.710148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf6eac-f8b7-4fcf-9591-8cf5f7bd3b15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:29.711571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf6eac-f8b7-4fcf-9591-8cf5f7bd3b15 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:29.720859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1249/2507] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:29.982802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849a919-bb39-4ee8-a764-f4faff03a151 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:29.983661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7849a919-bb39-4ee8-a764-f4faff03a151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:29.995515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849a919-bb39-4ee8-a764-f4faff03a151 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:30.001053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:30.001610 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:30.001885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:30.002185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] PATH_INFO: `/v3/projects/3da635d7b43f42c4a541465b76b58b2d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:30.003416 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da635d7b43f42c4a541465b76b58b2d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:30.005431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:30.058201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da635d7b43f42c4a541465b76b58b2d', 'request_id': 'req-e3600dca-3a0f-4905-8150-4fc58f3c82b2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.065520 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da635d7b43f42c4a541465b76b58b2d', 'request_id': 'req-e3600dca-3a0f-4905-8150-4fc58f3c82b2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.074114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da635d7b43f42c4a541465b76b58b2d', 'request_id': 'req-e3600dca-3a0f-4905-8150-4fc58f3c82b2'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.085918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] The token cache is being invalidate because project 3da635d7b43f42c4a541465b76b58b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:30.086252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.086887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.088371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1259/2508] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:29 2022] DELETE /identity/v3/projects/3da635d7b43f42c4a541465b76b58b2d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:30.092831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf6eac-f8b7-4fcf-9591-8cf5f7bd3b15 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:30.102834 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf6eac-f8b7-4fcf-9591-8cf5f7bd3b15 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:30.182743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c798c00-fdc9-4e52-bf10-370d9ab38f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:30.183515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c798c00-fdc9-4e52-bf10-370d9ab38f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:30.183970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c798c00-fdc9-4e52-bf10-370d9ab38f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:30.184831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c798c00-fdc9-4e52-bf10-370d9ab38f27 admin admin] PATH_INFO: `/v3/users/b0a94cc49df84337813314f352782b6a` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:30.186410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c798c00-fdc9-4e52-bf10-370d9ab38f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a94cc49df84337813314f352782b6a)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:30.188454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c798c00-fdc9-4e52-bf10-370d9ab38f27 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:30.257789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c798c00-fdc9-4e52-bf10-370d9ab38f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a94cc49df84337813314f352782b6a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.258710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c798c00-fdc9-4e52-bf10-370d9ab38f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a94cc49df84337813314f352782b6a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.259324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c798c00-fdc9-4e52-bf10-370d9ab38f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a94cc49df84337813314f352782b6a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.268679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c798c00-fdc9-4e52-bf10-370d9ab38f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a94cc49df84337813314f352782b6a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.280922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7c798c00-fdc9-4e52-bf10-370d9ab38f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a94cc49df84337813314f352782b6a'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.301839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1250/2509] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:30 2022] DELETE /identity/v3/users/b0a94cc49df84337813314f352782b6a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:30.576898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:30.578606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:30.594752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3600dca-3a0f-4905-8150-4fc58f3c82b2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:30.655075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:30.655784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:30.656059 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:30.656331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] PATH_INFO: `/v3/projects/00673da0ff804cf38f7b022df93e18a7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:30.657560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00673da0ff804cf38f7b022df93e18a7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:30.659491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:30.694176 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:30.711220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00673da0ff804cf38f7b022df93e18a7', 'request_id': 'req-4d7c375f-521e-49e4-8e79-c747d6768157'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.717487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00673da0ff804cf38f7b022df93e18a7', 'request_id': 'req-4d7c375f-521e-49e4-8e79-c747d6768157'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.724859 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00673da0ff804cf38f7b022df93e18a7', 'request_id': 'req-4d7c375f-521e-49e4-8e79-c747d6768157'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.736010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] The token cache is being invalidate because project 00673da0ff804cf38f7b022df93e18a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:30.736299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.736933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-4d7c375f-521e-49e4-8e79-c747d6768157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:30.738495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1260/2510] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:30 2022] DELETE /identity/v3/projects/00673da0ff804cf38f7b022df93e18a7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:30.743228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610c48f-9016-4b79-92aa-16d910139810 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:30.743684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610c48f-9016-4b79-92aa-16d910139810 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:30.743800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610c48f-9016-4b79-92aa-16d910139810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:30.765414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c610c48f-9016-4b79-92aa-16d910139810 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:30.766624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c610c48f-9016-4b79-92aa-16d910139810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:30.826139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1251/2511] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:30.834209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd03ae-9e5d-4ed5-a292-2ad612c91fac None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:30.834526 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd03ae-9e5d-4ed5-a292-2ad612c91fac None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:30.834939 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd03ae-9e5d-4ed5-a292-2ad612c91fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:30.856869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-90bd03ae-9e5d-4ed5-a292-2ad612c91fac None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:30.858117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-90bd03ae-9e5d-4ed5-a292-2ad612c91fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:30.866326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1261/2512] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:30.870551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610c48f-9016-4b79-92aa-16d910139810 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:30.876472 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:30.880528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610c48f-9016-4b79-92aa-16d910139810 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:30.886517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9136f-de2c-4713-b0d8-47622213990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:30.887843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9136f-de2c-4713-b0d8-47622213990d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:30.888303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9136f-de2c-4713-b0d8-47622213990d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:30.888622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9136f-de2c-4713-b0d8-47622213990d admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:30.889449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9136f-de2c-4713-b0d8-47622213990d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:30.889755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9136f-de2c-4713-b0d8-47622213990d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:30.891416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9136f-de2c-4713-b0d8-47622213990d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:30.903504 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1252/2513] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:28:30.907832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd03ae-9e5d-4ed5-a292-2ad612c91fac None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:30.917117 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd03ae-9e5d-4ed5-a292-2ad612c91fac None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:30.922576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975a5ef-3d69-4bf4-8311-1e2b7dc3f128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:30.923183 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975a5ef-3d69-4bf4-8311-1e2b7dc3f128 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:30.923462 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975a5ef-3d69-4bf4-8311-1e2b7dc3f128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:30.923741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975a5ef-3d69-4bf4-8311-1e2b7dc3f128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:30.924372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975a5ef-3d69-4bf4-8311-1e2b7dc3f128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:30.926295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975a5ef-3d69-4bf4-8311-1e2b7dc3f128 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:30.953853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1262/2514] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:30 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:30.958088 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9136f-de2c-4713-b0d8-47622213990d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:30.968666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9136f-de2c-4713-b0d8-47622213990d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:31.024252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67deb9-5fed-46fc-b5c2-66f6a0d91dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:31.024846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67deb9-5fed-46fc-b5c2-66f6a0d91dbf admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.025123 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67deb9-5fed-46fc-b5c2-66f6a0d91dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.025392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67deb9-5fed-46fc-b5c2-66f6a0d91dbf admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.026015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67deb9-5fed-46fc-b5c2-66f6a0d91dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:31.028578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67deb9-5fed-46fc-b5c2-66f6a0d91dbf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:31.049866 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1253/2515] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:30 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:31.054061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975a5ef-3d69-4bf4-8311-1e2b7dc3f128 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:31.065088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975a5ef-3d69-4bf4-8311-1e2b7dc3f128 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:31.069791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d4c22-8b14-41d2-a948-20b6159acbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:31.070417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d4c22-8b14-41d2-a948-20b6159acbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.070699 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d4c22-8b14-41d2-a948-20b6159acbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.070971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d4c22-8b14-41d2-a948-20b6159acbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.071628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d4c22-8b14-41d2-a948-20b6159acbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:31.073209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d4c22-8b14-41d2-a948-20b6159acbf4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:31.083652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1263/2516] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:31.087551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67deb9-5fed-46fc-b5c2-66f6a0d91dbf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:31.097421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67deb9-5fed-46fc-b5c2-66f6a0d91dbf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:31.101983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd2849-d5a6-46c6-8469-d7fa6314ca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:31.102594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd2849-d5a6-46c6-8469-d7fa6314ca1a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.102870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd2849-d5a6-46c6-8469-d7fa6314ca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.103137 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd2849-d5a6-46c6-8469-d7fa6314ca1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.103767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd2849-d5a6-46c6-8469-d7fa6314ca1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:31.105337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd2849-d5a6-46c6-8469-d7fa6314ca1a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:31.115419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1254/2517] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:31.119390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d4c22-8b14-41d2-a948-20b6159acbf4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:31.129694 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d4c22-8b14-41d2-a948-20b6159acbf4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:31.134339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d15d46-e802-4577-881e-fad3bd42f329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:31.134975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15d46-e802-4577-881e-fad3bd42f329 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.135256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15d46-e802-4577-881e-fad3bd42f329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.135532 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d15d46-e802-4577-881e-fad3bd42f329 admin admin] PATH_INFO: `/v3/projects/b6d2c88c4b6341bcb6b614a70fe47481/users/417ec89871c74754a71fb02d7b0bc210/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.150498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d15d46-e802-4577-881e-fad3bd42f329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d2c88c4b6341bcb6b614a70fe47481, user_id=417ec89871c74754a71fb02d7b0bc210, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:31.153164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d15d46-e802-4577-881e-fad3bd42f329 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:31.165603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1264/2518] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:31 2022] PUT /identity/v3/projects/b6d2c88c4b6341bcb6b614a70fe47481/users/417ec89871c74754a71fb02d7b0bc210/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:31.176946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5736d8-94c2-4332-8dd4-d71cb9406215 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.177233 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5736d8-94c2-4332-8dd4-d71cb9406215 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.177509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5736d8-94c2-4332-8dd4-d71cb9406215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.205232 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0c5736d8-94c2-4332-8dd4-d71cb9406215 None None] MFA Rules not processed for user `417ec89871c74754a71fb02d7b0bc210`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:31.206512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0c5736d8-94c2-4332-8dd4-d71cb9406215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:31.272900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1255/2519] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:31.277159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d15d46-e802-4577-881e-fad3bd42f329 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:31.341925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d15d46-e802-4577-881e-fad3bd42f329 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:31.346786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08488d7c-efee-4433-ab92-c1e59607715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:31.347382 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08488d7c-efee-4433-ab92-c1e59607715f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.347660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08488d7c-efee-4433-ab92-c1e59607715f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.347927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08488d7c-efee-4433-ab92-c1e59607715f admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.348572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08488d7c-efee-4433-ab92-c1e59607715f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:31.350478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08488d7c-efee-4433-ab92-c1e59607715f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:31.378300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1265/2520] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:31 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:31.382354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5736d8-94c2-4332-8dd4-d71cb9406215 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:31.394011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5736d8-94c2-4332-8dd4-d71cb9406215 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:31.463730 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2802eea-7f04-48f2-a594-f9a9b7c2d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:31.464323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2802eea-7f04-48f2-a594-f9a9b7c2d410 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.464683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2802eea-7f04-48f2-a594-f9a9b7c2d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.464957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2802eea-7f04-48f2-a594-f9a9b7c2d410 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.466052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2802eea-7f04-48f2-a594-f9a9b7c2d410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:31.468023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2802eea-7f04-48f2-a594-f9a9b7c2d410 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:31.476623 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:31.497900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1256/2521] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:31 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:31.501857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08488d7c-efee-4433-ab92-c1e59607715f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:31.512692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08488d7c-efee-4433-ab92-c1e59607715f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:31.520822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3f9b8-8f01-4087-9fa1-93183c682827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:31.525068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f9b8-8f01-4087-9fa1-93183c682827 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.525068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f9b8-8f01-4087-9fa1-93183c682827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.525068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f9b8-8f01-4087-9fa1-93183c682827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.532860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3f9b8-8f01-4087-9fa1-93183c682827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:31.532860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3f9b8-8f01-4087-9fa1-93183c682827 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:31.550222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1266/2522] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:31.555325 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2802eea-7f04-48f2-a594-f9a9b7c2d410 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:31.567122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2802eea-7f04-48f2-a594-f9a9b7c2d410 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:31.572633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c896b6e-af19-4a33-877b-e5ce049300b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:31.573618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896b6e-af19-4a33-877b-e5ce049300b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.573927 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896b6e-af19-4a33-877b-e5ce049300b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.574334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c896b6e-af19-4a33-877b-e5ce049300b2 admin admin] PATH_INFO: `/v3/projects/24a1c910bb86480b97c0086ebaee8a95/users/2c69425379ee45e7a2ff6319ec0eac16/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.617403 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c896b6e-af19-4a33-877b-e5ce049300b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a1c910bb86480b97c0086ebaee8a95, user_id=2c69425379ee45e7a2ff6319ec0eac16, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:31.621126 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c896b6e-af19-4a33-877b-e5ce049300b2 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:31.641923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1257/2523] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:31 2022] PUT /identity/v3/projects/24a1c910bb86480b97c0086ebaee8a95/users/2c69425379ee45e7a2ff6319ec0eac16/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:31.645887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3f9b8-8f01-4087-9fa1-93183c682827 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:31.662710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3f9b8-8f01-4087-9fa1-93183c682827 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:31.695186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:31.742722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb150ef-cb63-4859-8a06-af4824a0a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:31.743327 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb150ef-cb63-4859-8a06-af4824a0a2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.743608 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb150ef-cb63-4859-8a06-af4824a0a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.743885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb150ef-cb63-4859-8a06-af4824a0a2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.744673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb150ef-cb63-4859-8a06-af4824a0a2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:31.747186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb150ef-cb63-4859-8a06-af4824a0a2d9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:31.756977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1267/2524] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:28:31.761495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c896b6e-af19-4a33-877b-e5ce049300b2 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:31.771723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c896b6e-af19-4a33-877b-e5ce049300b2 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:31.776489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c392eb-25b0-4b9a-a397-d91a6bbae808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:31.777131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c392eb-25b0-4b9a-a397-d91a6bbae808 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.777405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c392eb-25b0-4b9a-a397-d91a6bbae808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.778425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c392eb-25b0-4b9a-a397-d91a6bbae808 admin admin] PATH_INFO: `/v3/projects/24a1c910bb86480b97c0086ebaee8a95/users/2c69425379ee45e7a2ff6319ec0eac16/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.780468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c392eb-25b0-4b9a-a397-d91a6bbae808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a1c910bb86480b97c0086ebaee8a95, user_id=2c69425379ee45e7a2ff6319ec0eac16, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:31.783109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c392eb-25b0-4b9a-a397-d91a6bbae808 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:31.794276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1258/2525] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:31 2022] PUT /identity/v3/projects/24a1c910bb86480b97c0086ebaee8a95/users/2c69425379ee45e7a2ff6319ec0eac16/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:31.804279 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cace58-ba48-4af0-aaff-67f5e3e55d95 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.804564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cace58-ba48-4af0-aaff-67f5e3e55d95 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.804836 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cace58-ba48-4af0-aaff-67f5e3e55d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.834180 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d0cace58-ba48-4af0-aaff-67f5e3e55d95 None None] MFA Rules not processed for user `2c69425379ee45e7a2ff6319ec0eac16`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:31.835395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d0cace58-ba48-4af0-aaff-67f5e3e55d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:31.904640 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1268/2526] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:31.915788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c392eb-25b0-4b9a-a397-d91a6bbae808 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:31.917453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-85c392eb-25b0-4b9a-a397-d91a6bbae808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:31.974268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c392eb-25b0-4b9a-a397-d91a6bbae808 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:31.977891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff5e8-fc6e-4aca-93e5-522e48715d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:31.978505 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff5e8-fc6e-4aca-93e5-522e48715d21 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:31.978778 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff5e8-fc6e-4aca-93e5-522e48715d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:31.979042 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff5e8-fc6e-4aca-93e5-522e48715d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:31.988418 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dff5e8-fc6e-4aca-93e5-522e48715d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:31.989818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dff5e8-fc6e-4aca-93e5-522e48715d21 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:31.999025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1259/2527] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:32.077348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cace58-ba48-4af0-aaff-67f5e3e55d95 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:32.087428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cace58-ba48-4af0-aaff-67f5e3e55d95 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:32.091767 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e034-d786-4741-8aea-61fdba734e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:32.092372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e034-d786-4741-8aea-61fdba734e1d service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:32.092653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e034-d786-4741-8aea-61fdba734e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:32.092925 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318e034-d786-4741-8aea-61fdba734e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:32.151850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318e034-d786-4741-8aea-61fdba734e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:32.153819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318e034-d786-4741-8aea-61fdba734e1d service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:32.162723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1269/2528] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:32.843067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff5e8-fc6e-4aca-93e5-522e48715d21 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:32.845833 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-70dff5e8-fc6e-4aca-93e5-522e48715d21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:32.909126 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff5e8-fc6e-4aca-93e5-522e48715d21 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:32.912738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a73a5-d8e8-4114-97f8-e807dfff108c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:32.913346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a73a5-d8e8-4114-97f8-e807dfff108c service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:32.913628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a73a5-d8e8-4114-97f8-e807dfff108c service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:32.913903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a73a5-d8e8-4114-97f8-e807dfff108c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:32.915667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-569a73a5-d8e8-4114-97f8-e807dfff108c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:32.980253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a73a5-d8e8-4114-97f8-e807dfff108c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:32.981748 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a73a5-d8e8-4114-97f8-e807dfff108c service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:32.991504 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1260/2529] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:36.626164 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e034-d786-4741-8aea-61fdba734e1d service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:36.628232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0318e034-d786-4741-8aea-61fdba734e1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:36.645165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318e034-d786-4741-8aea-61fdba734e1d service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:36.650764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119aa2d-611b-4e64-9d1c-011ceeab0fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:36.651403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119aa2d-611b-4e64-9d1c-011ceeab0fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:36.651672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119aa2d-611b-4e64-9d1c-011ceeab0fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:36.651945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119aa2d-611b-4e64-9d1c-011ceeab0fed admin admin] PATH_INFO: `/v3/users/c2c4ba36ac1240e0bbca86690a69b64c` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:36.653642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119aa2d-611b-4e64-9d1c-011ceeab0fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c4ba36ac1240e0bbca86690a69b64c)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:36.655636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119aa2d-611b-4e64-9d1c-011ceeab0fed admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:36.711116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:36.715965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a119aa2d-611b-4e64-9d1c-011ceeab0fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c4ba36ac1240e0bbca86690a69b64c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:36.724546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a119aa2d-611b-4e64-9d1c-011ceeab0fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c4ba36ac1240e0bbca86690a69b64c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:36.740907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a119aa2d-611b-4e64-9d1c-011ceeab0fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c4ba36ac1240e0bbca86690a69b64c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:36.749513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a119aa2d-611b-4e64-9d1c-011ceeab0fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c4ba36ac1240e0bbca86690a69b64c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:36.750352 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a119aa2d-611b-4e64-9d1c-011ceeab0fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c4ba36ac1240e0bbca86690a69b64c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:36.756802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1270/2530] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:36 2022] DELETE /identity/v3/users/c2c4ba36ac1240e0bbca86690a69b64c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:36.975712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a73a5-d8e8-4114-97f8-e807dfff108c service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:36.983121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:36.989177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a73a5-d8e8-4114-97f8-e807dfff108c service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:37.077339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:37.077978 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:37.078288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:37.078807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] PATH_INFO: `/v3/projects/71dff115693445b483b5c4f7fe476bcb` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:37.080315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71dff115693445b483b5c4f7fe476bcb)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:37.082301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:37.139304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71dff115693445b483b5c4f7fe476bcb', 'request_id': 'req-b6347822-dbf7-4e4c-b018-710d25d4cd84'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:37.145077 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71dff115693445b483b5c4f7fe476bcb', 'request_id': 'req-b6347822-dbf7-4e4c-b018-710d25d4cd84'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:37.153807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71dff115693445b483b5c4f7fe476bcb', 'request_id': 'req-b6347822-dbf7-4e4c-b018-710d25d4cd84'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:37.165629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] The token cache is being invalidate because project 71dff115693445b483b5c4f7fe476bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:37.165921 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:37.166599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6347822-dbf7-4e4c-b018-710d25d4cd84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:37.168082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1261/2531] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:36 2022] DELETE /identity/v3/projects/71dff115693445b483b5c4f7fe476bcb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:37.173808 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892afa5f-fe76-4f0b-adad-18b50fca3cb5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:37.174118 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892afa5f-fe76-4f0b-adad-18b50fca3cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:37.174419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892afa5f-fe76-4f0b-adad-18b50fca3cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:37.194309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-892afa5f-fe76-4f0b-adad-18b50fca3cb5 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:37.195870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-892afa5f-fe76-4f0b-adad-18b50fca3cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:37.263387 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1271/2532] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:37.273556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db869253-3aca-477d-8348-6a0f52f67b81 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:37.273780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db869253-3aca-477d-8348-6a0f52f67b81 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:37.274076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db869253-3aca-477d-8348-6a0f52f67b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:37.296373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-db869253-3aca-477d-8348-6a0f52f67b81 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:37.297593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-db869253-3aca-477d-8348-6a0f52f67b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:37.307058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1262/2533] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:37.311210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892afa5f-fe76-4f0b-adad-18b50fca3cb5 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:37.321202 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892afa5f-fe76-4f0b-adad-18b50fca3cb5 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:37.326834 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3e06b-3b58-4925-b53a-cc987c5c8b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:37.327445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3e06b-3b58-4925-b53a-cc987c5c8b03 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:37.327811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3e06b-3b58-4925-b53a-cc987c5c8b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:37.328211 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3e06b-3b58-4925-b53a-cc987c5c8b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:37.329047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3e06b-3b58-4925-b53a-cc987c5c8b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:37.329379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3e06b-3b58-4925-b53a-cc987c5c8b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:37.331045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3e06b-3b58-4925-b53a-cc987c5c8b03 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:37.345409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1272/2534] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:28:37.350291 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db869253-3aca-477d-8348-6a0f52f67b81 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:37.361440 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db869253-3aca-477d-8348-6a0f52f67b81 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:37.366012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb33ce-2d10-4aec-aca6-bdf1b1a4f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:37.366625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb33ce-2d10-4aec-aca6-bdf1b1a4f20e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:37.366898 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb33ce-2d10-4aec-aca6-bdf1b1a4f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:37.367165 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb33ce-2d10-4aec-aca6-bdf1b1a4f20e admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:37.367780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb33ce-2d10-4aec-aca6-bdf1b1a4f20e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:37.369647 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb33ce-2d10-4aec-aca6-bdf1b1a4f20e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:37.395720 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1263/2535] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:37 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:37.399810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3e06b-3b58-4925-b53a-cc987c5c8b03 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:37.410495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3e06b-3b58-4925-b53a-cc987c5c8b03 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:37.468777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2f514-2a2c-4b1a-9e3a-f0f6a9c24b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:37.469356 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2f514-2a2c-4b1a-9e3a-f0f6a9c24b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:37.469638 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2f514-2a2c-4b1a-9e3a-f0f6a9c24b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:37.469934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2f514-2a2c-4b1a-9e3a-f0f6a9c24b6f admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:37.470578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2f514-2a2c-4b1a-9e3a-f0f6a9c24b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:37.472910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2f514-2a2c-4b1a-9e3a-f0f6a9c24b6f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:37.493471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1273/2536] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:37 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:37.497870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb33ce-2d10-4aec-aca6-bdf1b1a4f20e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:37.508115 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb33ce-2d10-4aec-aca6-bdf1b1a4f20e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:37.513560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ef88c-0249-4bda-b504-6c81eef27b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:37.514190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ef88c-0249-4bda-b504-6c81eef27b35 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:37.514464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ef88c-0249-4bda-b504-6c81eef27b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:37.514731 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ef88c-0249-4bda-b504-6c81eef27b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:37.515370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ef88c-0249-4bda-b504-6c81eef27b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:37.516933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ef88c-0249-4bda-b504-6c81eef27b35 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:37.531360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1264/2537] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:37.532896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2f514-2a2c-4b1a-9e3a-f0f6a9c24b6f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:37.543042 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2f514-2a2c-4b1a-9e3a-f0f6a9c24b6f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:37.547675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdf15f-18d9-4e7a-b670-6879b0a3d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:37.548263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdf15f-18d9-4e7a-b670-6879b0a3d48e admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:37.548538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdf15f-18d9-4e7a-b670-6879b0a3d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:37.548808 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdf15f-18d9-4e7a-b670-6879b0a3d48e admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:37.549452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdf15f-18d9-4e7a-b670-6879b0a3d48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:37.551212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdf15f-18d9-4e7a-b670-6879b0a3d48e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:37.563479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1274/2538] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:37.567671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ef88c-0249-4bda-b504-6c81eef27b35 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:37.578183 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ef88c-0249-4bda-b504-6c81eef27b35 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:37.582569 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eab829-f7e3-4a2d-a7dd-c4bedf56ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:37.583205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eab829-f7e3-4a2d-a7dd-c4bedf56ff49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:37.583476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eab829-f7e3-4a2d-a7dd-c4bedf56ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:37.583740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eab829-f7e3-4a2d-a7dd-c4bedf56ff49 admin admin] PATH_INFO: `/v3/projects/7103a8eebeb2451a965af3717c96bf3b/users/e198be6f6c914c3290078a1cd763e093/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:37.599552 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eab829-f7e3-4a2d-a7dd-c4bedf56ff49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7103a8eebeb2451a965af3717c96bf3b, user_id=e198be6f6c914c3290078a1cd763e093, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:37.602412 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eab829-f7e3-4a2d-a7dd-c4bedf56ff49 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:37.615220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1265/2539] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:37 2022] PUT /identity/v3/projects/7103a8eebeb2451a965af3717c96bf3b/users/e198be6f6c914c3290078a1cd763e093/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:37.625193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8abfc-8d1f-4be7-bf30-5c3ba6ee5ad1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:37.625480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8abfc-8d1f-4be7-bf30-5c3ba6ee5ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:37.625792 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8abfc-8d1f-4be7-bf30-5c3ba6ee5ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:37.660240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-08c8abfc-8d1f-4be7-bf30-5c3ba6ee5ad1 None None] MFA Rules not processed for user `e198be6f6c914c3290078a1cd763e093`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:37.661847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-08c8abfc-8d1f-4be7-bf30-5c3ba6ee5ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:37.674292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:37.747802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1275/2540] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:37.759267 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eab829-f7e3-4a2d-a7dd-c4bedf56ff49 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:37.760975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-48eab829-f7e3-4a2d-a7dd-c4bedf56ff49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:37.798179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:37.841070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eab829-f7e3-4a2d-a7dd-c4bedf56ff49 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:37.846841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f9d0b-10a7-4488-8728-eb010a263a43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:37.847449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f9d0b-10a7-4488-8728-eb010a263a43 service nova] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:37.847726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f9d0b-10a7-4488-8728-eb010a263a43 service nova] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:37.847995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f9d0b-10a7-4488-8728-eb010a263a43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:37.855946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f9d0b-10a7-4488-8728-eb010a263a43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:37.857559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f9d0b-10a7-4488-8728-eb010a263a43 service nova] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:37.867964 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1266/2541] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:39.582642 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8abfc-8d1f-4be7-bf30-5c3ba6ee5ad1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:39.584129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-08c8abfc-8d1f-4be7-bf30-5c3ba6ee5ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:39.648307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8abfc-8d1f-4be7-bf30-5c3ba6ee5ad1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:39.652986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:39.653625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:39.653898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:39.654195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] PATH_INFO: `/v3/users/417ec89871c74754a71fb02d7b0bc210` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:39.655363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=417ec89871c74754a71fb02d7b0bc210)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:39.657332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:39.703514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417ec89871c74754a71fb02d7b0bc210'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:39.710802 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417ec89871c74754a71fb02d7b0bc210'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:39.723538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417ec89871c74754a71fb02d7b0bc210'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:39.730592 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417ec89871c74754a71fb02d7b0bc210'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:39.731706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417ec89871c74754a71fb02d7b0bc210'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:39.737704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1276/2542] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:39 2022] DELETE /identity/v3/users/417ec89871c74754a71fb02d7b0bc210 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:39.742560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674048c-fa40-4de9-8c24-8adde8a9443b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:39.743034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674048c-fa40-4de9-8c24-8adde8a9443b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:39.743139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674048c-fa40-4de9-8c24-8adde8a9443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:39.765195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7674048c-fa40-4de9-8c24-8adde8a9443b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:39.766576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7674048c-fa40-4de9-8c24-8adde8a9443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:39.825989 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1267/2543] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:39.837753 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:39.839603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:39.877756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:39.903403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e506be-765f-40b2-b374-64aa2f1c9f99 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:39.906961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4189c93-950d-4c09-9041-f3432278a88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:39.907563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4189c93-950d-4c09-9041-f3432278a88b service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:39.907841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4189c93-950d-4c09-9041-f3432278a88b service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:39.908113 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4189c93-950d-4c09-9041-f3432278a88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:39.917237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4189c93-950d-4c09-9041-f3432278a88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:39.919217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4189c93-950d-4c09-9041-f3432278a88b service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:39.929019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1277/2544] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:40.207338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674048c-fa40-4de9-8c24-8adde8a9443b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:40.209235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7674048c-fa40-4de9-8c24-8adde8a9443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:40.234061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674048c-fa40-4de9-8c24-8adde8a9443b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:40.236167 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:40.236822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:40.237216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:40.237375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] PATH_INFO: `/v3/projects/b6d2c88c4b6341bcb6b614a70fe47481` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:40.239288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d2c88c4b6341bcb6b614a70fe47481)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:40.240790 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:40.288839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d2c88c4b6341bcb6b614a70fe47481', 'request_id': 'req-921a54cc-965f-47bf-ba6a-64e699d71050'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.295043 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d2c88c4b6341bcb6b614a70fe47481', 'request_id': 'req-921a54cc-965f-47bf-ba6a-64e699d71050'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.303117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d2c88c4b6341bcb6b614a70fe47481', 'request_id': 'req-921a54cc-965f-47bf-ba6a-64e699d71050'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.315674 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] The token cache is being invalidate because project b6d2c88c4b6341bcb6b614a70fe47481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:40.315966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.316617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.318306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1268/2545] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:40 2022] DELETE /identity/v3/projects/b6d2c88c4b6341bcb6b614a70fe47481 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:40.322545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4189c93-950d-4c09-9041-f3432278a88b service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:40.332203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4189c93-950d-4c09-9041-f3432278a88b service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:40.392789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:40.393433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:40.393716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:40.393992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] PATH_INFO: `/v3/users/2c69425379ee45e7a2ff6319ec0eac16` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:40.395149 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c69425379ee45e7a2ff6319ec0eac16)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:40.397079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:40.446698 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c69425379ee45e7a2ff6319ec0eac16'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.454372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c69425379ee45e7a2ff6319ec0eac16'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.468760 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c69425379ee45e7a2ff6319ec0eac16'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.487390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c69425379ee45e7a2ff6319ec0eac16'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.487390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c69425379ee45e7a2ff6319ec0eac16'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.487390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1278/2546] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:40 2022] DELETE /identity/v3/users/2c69425379ee45e7a2ff6319ec0eac16 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:40.605228 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:40.605616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:40.620104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a54cc-965f-47bf-ba6a-64e699d71050 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:40.662436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:40.687836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2b6f5-0162-4676-a677-d46b12bc369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:40.688468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2b6f5-0162-4676-a677-d46b12bc369f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:40.688750 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2b6f5-0162-4676-a677-d46b12bc369f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:40.689019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2b6f5-0162-4676-a677-d46b12bc369f admin admin] PATH_INFO: `/v3/users/e198be6f6c914c3290078a1cd763e093` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:40.690176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2b6f5-0162-4676-a677-d46b12bc369f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e198be6f6c914c3290078a1cd763e093)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:40.692089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2b6f5-0162-4676-a677-d46b12bc369f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:40.747673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-70e2b6f5-0162-4676-a677-d46b12bc369f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e198be6f6c914c3290078a1cd763e093'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.748382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-70e2b6f5-0162-4676-a677-d46b12bc369f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e198be6f6c914c3290078a1cd763e093'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.748949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-70e2b6f5-0162-4676-a677-d46b12bc369f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e198be6f6c914c3290078a1cd763e093'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.760512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-70e2b6f5-0162-4676-a677-d46b12bc369f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e198be6f6c914c3290078a1cd763e093'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.769612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-70e2b6f5-0162-4676-a677-d46b12bc369f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e198be6f6c914c3290078a1cd763e093'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.778222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:40.779655 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:40.794489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e8b93-608c-4e97-a3b6-a839004df884 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:40.798429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1269/2547] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:40 2022] DELETE /identity/v3/users/e198be6f6c914c3290078a1cd763e093 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:28:40.799945 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966f0a-68aa-4ba6-9c10-91463380268b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:40.800237 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966f0a-68aa-4ba6-9c10-91463380268b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:40.800547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57966f0a-68aa-4ba6-9c10-91463380268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:40.821470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-57966f0a-68aa-4ba6-9c10-91463380268b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:40.822711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-57966f0a-68aa-4ba6-9c10-91463380268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:40.853509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:40.866729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:40.867576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:40.867930 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:40.868290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] PATH_INFO: `/v3/projects/24a1c910bb86480b97c0086ebaee8a95` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:40.869475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a1c910bb86480b97c0086ebaee8a95)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:40.871458 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:40.898395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1270/2548] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:40.908935 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57966f0a-68aa-4ba6-9c10-91463380268b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:40.910346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-57966f0a-68aa-4ba6-9c10-91463380268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:40.927667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a1c910bb86480b97c0086ebaee8a95', 'request_id': 'req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.935410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a1c910bb86480b97c0086ebaee8a95', 'request_id': 'req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.945032 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a1c910bb86480b97c0086ebaee8a95', 'request_id': 'req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.957153 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] The token cache is being invalidate because project 24a1c910bb86480b97c0086ebaee8a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:40.957592 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.958645 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f4f3e2e2-01e9-41ad-ab44-d34e1d170bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:40.960207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1279/2549] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:40 2022] DELETE /identity/v3/projects/24a1c910bb86480b97c0086ebaee8a95 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:28:40.964769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7699c-fe5b-497b-b812-6022352db816 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:40.965050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7699c-fe5b-497b-b812-6022352db816 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:40.965320 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7699c-fe5b-497b-b812-6022352db816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:40.974706 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57966f0a-68aa-4ba6-9c10-91463380268b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:40.987081 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-15a7699c-fe5b-497b-b812-6022352db816 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:40.988359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-15a7699c-fe5b-497b-b812-6022352db816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:40.989360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:41.035861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110c294-9f66-4659-a18a-38483da68fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.036523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c294-9f66-4659-a18a-38483da68fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.036808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c294-9f66-4659-a18a-38483da68fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.037079 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110c294-9f66-4659-a18a-38483da68fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.038913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3110c294-9f66-4659-a18a-38483da68fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:41.052232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1280/2550] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:41.061544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05996e59-fe6b-4f3b-83a2-85bee51b06b0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.061836 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05996e59-fe6b-4f3b-83a2-85bee51b06b0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.062146 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05996e59-fe6b-4f3b-83a2-85bee51b06b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.082479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-05996e59-fe6b-4f3b-83a2-85bee51b06b0 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:41.083848 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-05996e59-fe6b-4f3b-83a2-85bee51b06b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:41.092121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1281/2551] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:41.096223 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05996e59-fe6b-4f3b-83a2-85bee51b06b0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.105466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05996e59-fe6b-4f3b-83a2-85bee51b06b0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.108230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110c294-9f66-4659-a18a-38483da68fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.109662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110c294-9f66-4659-a18a-38483da68fd9 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.110170 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107d03c-998a-46c2-95a9-d3619cd3e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.110765 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107d03c-998a-46c2-95a9-d3619cd3e4ba admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.111043 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107d03c-998a-46c2-95a9-d3619cd3e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.111313 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107d03c-998a-46c2-95a9-d3619cd3e4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.111953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107d03c-998a-46c2-95a9-d3619cd3e4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:41.112258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107d03c-998a-46c2-95a9-d3619cd3e4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.113829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107d03c-998a-46c2-95a9-d3619cd3e4ba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.119148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1271/2552] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:28:41.126108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1282/2553] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:28:41.131029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110c294-9f66-4659-a18a-38483da68fd9 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.141090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110c294-9f66-4659-a18a-38483da68fd9 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.145851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1032d-cfad-4dd1-b21d-340eca33c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.146479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1032d-cfad-4dd1-b21d-340eca33c545 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.146755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1032d-cfad-4dd1-b21d-340eca33c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.147018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1032d-cfad-4dd1-b21d-340eca33c545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.147631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1032d-cfad-4dd1-b21d-340eca33c545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.149493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1032d-cfad-4dd1-b21d-340eca33c545 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.179549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1272/2554] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:41 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:41.184010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107d03c-998a-46c2-95a9-d3619cd3e4ba admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.195001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107d03c-998a-46c2-95a9-d3619cd3e4ba admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.260594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a630d17-049c-46a4-8af8-b0cad163757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.261251 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a630d17-049c-46a4-8af8-b0cad163757c admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.261489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a630d17-049c-46a4-8af8-b0cad163757c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.261755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a630d17-049c-46a4-8af8-b0cad163757c admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.262447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a630d17-049c-46a4-8af8-b0cad163757c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.264393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a630d17-049c-46a4-8af8-b0cad163757c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.276015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:41.299890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1283/2555] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:41 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:41.301085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1032d-cfad-4dd1-b21d-340eca33c545 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.312285 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1032d-cfad-4dd1-b21d-340eca33c545 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.317229 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cb59c-a4bc-4560-8d11-239cb8a6fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.318071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb59c-a4bc-4560-8d11-239cb8a6fa36 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.318343 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb59c-a4bc-4560-8d11-239cb8a6fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.318609 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cb59c-a4bc-4560-8d11-239cb8a6fa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.319253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cb59c-a4bc-4560-8d11-239cb8a6fa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.320826 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cb59c-a4bc-4560-8d11-239cb8a6fa36 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.332724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1273/2556] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:28:41.336971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a630d17-049c-46a4-8af8-b0cad163757c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.348202 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a630d17-049c-46a4-8af8-b0cad163757c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.353395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5427859-8318-405e-9309-c1ac16d7bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.354083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5427859-8318-405e-9309-c1ac16d7bfaf admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.354369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5427859-8318-405e-9309-c1ac16d7bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.354697 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5427859-8318-405e-9309-c1ac16d7bfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.355275 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5427859-8318-405e-9309-c1ac16d7bfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.357431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5427859-8318-405e-9309-c1ac16d7bfaf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.370973 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1284/2557] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:28:41.376069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cb59c-a4bc-4560-8d11-239cb8a6fa36 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.385987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cb59c-a4bc-4560-8d11-239cb8a6fa36 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.390617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e6d08-aad8-45e1-b081-b395cceaaf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.391257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e6d08-aad8-45e1-b081-b395cceaaf52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.391531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e6d08-aad8-45e1-b081-b395cceaaf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.391800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e6d08-aad8-45e1-b081-b395cceaaf52 admin admin] PATH_INFO: `/v3/projects/2a726bc180ca411b9e0cfb9191daf366/users/c8e993a944994afc871a31cb678cc023/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.412919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e6d08-aad8-45e1-b081-b395cceaaf52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a726bc180ca411b9e0cfb9191daf366, user_id=c8e993a944994afc871a31cb678cc023, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.415608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e6d08-aad8-45e1-b081-b395cceaaf52 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.423123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5427859-8318-405e-9309-c1ac16d7bfaf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.424900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f5427859-8318-405e-9309-c1ac16d7bfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:41.436365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1274/2558] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:41 2022] PUT /identity/v3/projects/2a726bc180ca411b9e0cfb9191daf366/users/c8e993a944994afc871a31cb678cc023/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:28:41.448151 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eb43e-3f35-4654-8aca-a92a83662049 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.448464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eb43e-3f35-4654-8aca-a92a83662049 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.448773 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eb43e-3f35-4654-8aca-a92a83662049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.451115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5427859-8318-405e-9309-c1ac16d7bfaf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.482936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8d6eb43e-3f35-4654-8aca-a92a83662049 None None] MFA Rules not processed for user `c8e993a944994afc871a31cb678cc023`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:41.484108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8d6eb43e-3f35-4654-8aca-a92a83662049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:41.520393 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.521493 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.521992 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.522235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] PATH_INFO: `/v3/projects/7103a8eebeb2451a965af3717c96bf3b` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.531186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7103a8eebeb2451a965af3717c96bf3b)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.536016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.558483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:41.568522 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1275/2559] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:41.569533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eb43e-3f35-4654-8aca-a92a83662049 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.580529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eb43e-3f35-4654-8aca-a92a83662049 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.585336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1ca17-29f4-4704-b490-f5721f5327ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.585955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1ca17-29f4-4704-b490-f5721f5327ee admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.586256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1ca17-29f4-4704-b490-f5721f5327ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.586530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1ca17-29f4-4704-b490-f5721f5327ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.587160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1ca17-29f4-4704-b490-f5721f5327ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.589049 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1ca17-29f4-4704-b490-f5721f5327ee admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.596869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7103a8eebeb2451a965af3717c96bf3b', 'request_id': 'req-20fc6201-9751-4a2e-bf68-6667add5b7d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:41.602439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7103a8eebeb2451a965af3717c96bf3b', 'request_id': 'req-20fc6201-9751-4a2e-bf68-6667add5b7d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:41.615057 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7103a8eebeb2451a965af3717c96bf3b', 'request_id': 'req-20fc6201-9751-4a2e-bf68-6667add5b7d7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:41.618610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1276/2560] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:41 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:41.622684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1ca17-29f4-4704-b490-f5721f5327ee admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.629723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] The token cache is being invalidate because project 7103a8eebeb2451a965af3717c96bf3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:41.630016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:41.630749 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-20fc6201-9751-4a2e-bf68-6667add5b7d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:41.632229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1285/2561] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:41 2022] DELETE /identity/v3/projects/7103a8eebeb2451a965af3717c96bf3b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:28:41.637137 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cdd7d-7bab-4f16-ada6-0db3806c55e3 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.637475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cdd7d-7bab-4f16-ada6-0db3806c55e3 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.637872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cdd7d-7bab-4f16-ada6-0db3806c55e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.661217 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9e1cdd7d-7bab-4f16-ada6-0db3806c55e3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:41.661826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9e1cdd7d-7bab-4f16-ada6-0db3806c55e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:41.697559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1ca17-29f4-4704-b490-f5721f5327ee admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.702384 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c449c-8dff-4502-b44a-3b18cbe152c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.702993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c449c-8dff-4502-b44a-3b18cbe152c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.703276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c449c-8dff-4502-b44a-3b18cbe152c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.703550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c449c-8dff-4502-b44a-3b18cbe152c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.704181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c449c-8dff-4502-b44a-3b18cbe152c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.706218 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c449c-8dff-4502-b44a-3b18cbe152c6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.724833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1286/2562] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:41.729673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1277/2563] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:41 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:41.734229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cdd7d-7bab-4f16-ada6-0db3806c55e3 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.735806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9e1cdd7d-7bab-4f16-ada6-0db3806c55e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:41.735946 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566346-3520-461b-ad4a-a07167b182c0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.736164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566346-3520-461b-ad4a-a07167b182c0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.736441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566346-3520-461b-ad4a-a07167b182c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.749112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cdd7d-7bab-4f16-ada6-0db3806c55e3 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.756380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e3566346-3520-461b-ad4a-a07167b182c0 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:41.757601 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e3566346-3520-461b-ad4a-a07167b182c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:41.762020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e3ec0-1bf1-4808-939c-c0cb83b2570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.762807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e3ec0-1bf1-4808-939c-c0cb83b2570f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.763194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e3ec0-1bf1-4808-939c-c0cb83b2570f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.763474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e3ec0-1bf1-4808-939c-c0cb83b2570f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.764281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e3ec0-1bf1-4808-939c-c0cb83b2570f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.766020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1278/2564] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:41.766260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e3ec0-1bf1-4808-939c-c0cb83b2570f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.770317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3566346-3520-461b-ad4a-a07167b182c0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.783045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1287/2565] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:41.783530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3566346-3520-461b-ad4a-a07167b182c0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.784730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e3ec0-1bf1-4808-939c-c0cb83b2570f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.784878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaba916-f3ce-4b37-91cb-30defdc9d62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.785385 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaba916-f3ce-4b37-91cb-30defdc9d62a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.785665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaba916-f3ce-4b37-91cb-30defdc9d62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.785933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaba916-f3ce-4b37-91cb-30defdc9d62a admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.786642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaba916-f3ce-4b37-91cb-30defdc9d62a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:41.786929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaba916-f3ce-4b37-91cb-30defdc9d62a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.788523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaba916-f3ce-4b37-91cb-30defdc9d62a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.789731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:41.796728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e3ec0-1bf1-4808-939c-c0cb83b2570f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.802635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1279/2566] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:28:41.807205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaba916-f3ce-4b37-91cb-30defdc9d62a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.807351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665a960-c0ce-4ec1-bd11-102ccc4189f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.808014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a960-c0ce-4ec1-bd11-102ccc4189f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.808300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a960-c0ce-4ec1-bd11-102ccc4189f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.808568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665a960-c0ce-4ec1-bd11-102ccc4189f1 admin admin] PATH_INFO: `/v3/projects/23dbb77d6b9d44b788025abf49ec89c2/users/b8796ad1243443198717021a38ea0a91/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.818068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaba916-f3ce-4b37-91cb-30defdc9d62a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.822708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903db0ce-f9f3-4dfb-9886-a4fc759332cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.823299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903db0ce-f9f3-4dfb-9886-a4fc759332cb admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.823578 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903db0ce-f9f3-4dfb-9886-a4fc759332cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.823843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903db0ce-f9f3-4dfb-9886-a4fc759332cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.824451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903db0ce-f9f3-4dfb-9886-a4fc759332cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.824778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665a960-c0ce-4ec1-bd11-102ccc4189f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dbb77d6b9d44b788025abf49ec89c2, user_id=b8796ad1243443198717021a38ea0a91, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.826572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903db0ce-f9f3-4dfb-9886-a4fc759332cb admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.827463 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665a960-c0ce-4ec1-bd11-102ccc4189f1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.843320 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1288/2567] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:41 2022] PUT /identity/v3/projects/23dbb77d6b9d44b788025abf49ec89c2/users/b8796ad1243443198717021a38ea0a91/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:41.848063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665a960-c0ce-4ec1-bd11-102ccc4189f1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.860364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1280/2568] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:41 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:41.864594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903db0ce-f9f3-4dfb-9886-a4fc759332cb admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.917646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665a960-c0ce-4ec1-bd11-102ccc4189f1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.932397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903db0ce-f9f3-4dfb-9886-a4fc759332cb admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.938358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb4d7a-16fd-483f-b684-33f94b356899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.938969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb4d7a-16fd-483f-b684-33f94b356899 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.939251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb4d7a-16fd-483f-b684-33f94b356899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.939521 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb4d7a-16fd-483f-b684-33f94b356899 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.940145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb4d7a-16fd-483f-b684-33f94b356899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.942067 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb4d7a-16fd-483f-b684-33f94b356899 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.968563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1281/2569] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:41 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:41.969849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb4d7a-16fd-483f-b684-33f94b356899 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:41.979654 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb4d7a-16fd-483f-b684-33f94b356899 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:41.980305 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40560f67-9ad3-4b94-97a0-094bc20b8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.980922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40560f67-9ad3-4b94-97a0-094bc20b8588 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.981207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40560f67-9ad3-4b94-97a0-094bc20b8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.981479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40560f67-9ad3-4b94-97a0-094bc20b8588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.982152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40560f67-9ad3-4b94-97a0-094bc20b8588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.983821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40560f67-9ad3-4b94-97a0-094bc20b8588 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.984312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074e8c3-a444-4d1c-bee6-bd71268dab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:41.984831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074e8c3-a444-4d1c-bee6-bd71268dab1e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:41.985109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074e8c3-a444-4d1c-bee6-bd71268dab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:41.985377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074e8c3-a444-4d1c-bee6-bd71268dab1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:41.986299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074e8c3-a444-4d1c-bee6-bd71268dab1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:41.987969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074e8c3-a444-4d1c-bee6-bd71268dab1e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:41.998457 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1289/2570] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:28:41.998809 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1282/2571] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:28:41.999468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40560f67-9ad3-4b94-97a0-094bc20b8588 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:42.002157 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074e8c3-a444-4d1c-bee6-bd71268dab1e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:42.007056 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:42.010016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40560f67-9ad3-4b94-97a0-094bc20b8588 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:42.012179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074e8c3-a444-4d1c-bee6-bd71268dab1e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:42.015573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c383802-1046-4beb-b0bc-3cae3179db5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:42.016404 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c383802-1046-4beb-b0bc-3cae3179db5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:42.016681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c383802-1046-4beb-b0bc-3cae3179db5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:42.016949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c383802-1046-4beb-b0bc-3cae3179db5b admin admin] PATH_INFO: `/v3/projects/23dbb77d6b9d44b788025abf49ec89c2/users/b8796ad1243443198717021a38ea0a91/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:42.018689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91f79-2641-4c73-9f5b-c350521bc930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:42.018919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c383802-1046-4beb-b0bc-3cae3179db5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dbb77d6b9d44b788025abf49ec89c2, user_id=b8796ad1243443198717021a38ea0a91, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:42.019289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91f79-2641-4c73-9f5b-c350521bc930 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:42.019572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91f79-2641-4c73-9f5b-c350521bc930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:42.019876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91f79-2641-4c73-9f5b-c350521bc930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:42.020545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c91f79-2641-4c73-9f5b-c350521bc930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:42.021673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c383802-1046-4beb-b0bc-3cae3179db5b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:42.022181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c91f79-2641-4c73-9f5b-c350521bc930 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:42.032999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1290/2572] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:41 2022] PUT /identity/v3/projects/23dbb77d6b9d44b788025abf49ec89c2/users/b8796ad1243443198717021a38ea0a91/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:42.039570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1283/2573] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:28:42.040603 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c383802-1046-4beb-b0bc-3cae3179db5b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:42.042957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066e493-42db-428f-b871-b7393975d18b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:42.043241 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066e493-42db-428f-b871-b7393975d18b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:42.043512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066e493-42db-428f-b871-b7393975d18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:42.072461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-3066e493-42db-428f-b871-b7393975d18b None None] MFA Rules not processed for user `b8796ad1243443198717021a38ea0a91`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:42.073670 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3066e493-42db-428f-b871-b7393975d18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:42.104886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c383802-1046-4beb-b0bc-3cae3179db5b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:42.109574 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db1f45-838b-4efa-b6b1-5fea7e82b2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:42.110253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db1f45-838b-4efa-b6b1-5fea7e82b2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:42.110536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db1f45-838b-4efa-b6b1-5fea7e82b2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:42.110809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db1f45-838b-4efa-b6b1-5fea7e82b2c0 admin admin] PATH_INFO: `/v3/projects/28633bc6899944e38fdbe9c98402b884/users/d0eabb76df3242d5a237a4dd49031cbf/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:42.122660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:42.126273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db1f45-838b-4efa-b6b1-5fea7e82b2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28633bc6899944e38fdbe9c98402b884, user_id=d0eabb76df3242d5a237a4dd49031cbf, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:42.132506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db1f45-838b-4efa-b6b1-5fea7e82b2c0 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:42.144994 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1291/2574] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:42 2022] PUT /identity/v3/projects/28633bc6899944e38fdbe9c98402b884/users/d0eabb76df3242d5a237a4dd49031cbf/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:28:42.147939 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1284/2575] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:42.156706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1bfe-9bf8-4086-ba0a-d97222e5e652 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:42.156989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1bfe-9bf8-4086-ba0a-d97222e5e652 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:42.157265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1bfe-9bf8-4086-ba0a-d97222e5e652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:42.161344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066e493-42db-428f-b871-b7393975d18b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:42.162997 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-3066e493-42db-428f-b871-b7393975d18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:42.188433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-9a2b1bfe-9bf8-4086-ba0a-d97222e5e652 None None] MFA Rules not processed for user `d0eabb76df3242d5a237a4dd49031cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:42.189689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9a2b1bfe-9bf8-4086-ba0a-d97222e5e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:42.221160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066e493-42db-428f-b871-b7393975d18b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:42.255524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1292/2576] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:42.267455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b1bfe-9bf8-4086-ba0a-d97222e5e652 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:42.269084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9a2b1bfe-9bf8-4086-ba0a-d97222e5e652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:42.273243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2359e-5d33-4f5e-b3f2-c429f9650973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:42.273860 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2359e-5d33-4f5e-b3f2-c429f9650973 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:42.274185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2359e-5d33-4f5e-b3f2-c429f9650973 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:42.274777 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2359e-5d33-4f5e-b3f2-c429f9650973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:42.281089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b1bfe-9bf8-4086-ba0a-d97222e5e652 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:42.285089 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c9ce-a86c-4d0b-95f8-e4c9b0f0f9f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:42.285821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c9ce-a86c-4d0b-95f8-e4c9b0f0f9f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:42.286245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c9ce-a86c-4d0b-95f8-e4c9b0f0f9f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:42.286523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c9ce-a86c-4d0b-95f8-e4c9b0f0f9f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:42.296142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228c9ce-a86c-4d0b-95f8-e4c9b0f0f9f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:42.297584 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228c9ce-a86c-4d0b-95f8-e4c9b0f0f9f3 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:42.306686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1293/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:28:42.326148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:42.343569 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2359e-5d33-4f5e-b3f2-c429f9650973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:42.345003 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2359e-5d33-4f5e-b3f2-c429f9650973 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:42.355345 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1285/2578] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:42.714915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c9ce-a86c-4d0b-95f8-e4c9b0f0f9f3 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:42.725737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c9ce-a86c-4d0b-95f8-e4c9b0f0f9f3 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:42.730264 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a92d2-2c7b-45a0-914d-cd80b4145df5 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8796ad1243443198717021a38ea0a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23dbb77d6b9d44b788025abf49ec89c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:42.730862 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a92d2-2c7b-45a0-914d-cd80b4145df5 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:42.731677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a92d2-2c7b-45a0-914d-cd80b4145df5 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:42.731972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a92d2-2c7b-45a0-914d-cd80b4145df5 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:42.732593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a92d2-2c7b-45a0-914d-cd80b4145df5 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:42.732899 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a92d2-2c7b-45a0-914d-cd80b4145df5 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:42.734518 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a92d2-2c7b-45a0-914d-cd80b4145df5 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:42.745961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1294/2579] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:28:42.750667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2359e-5d33-4f5e-b3f2-c429f9650973 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:42.759821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2359e-5d33-4f5e-b3f2-c429f9650973 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:42.764389 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b286fb-bb7f-49e6-8d82-3b7a65eb0f0e tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8796ad1243443198717021a38ea0a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23dbb77d6b9d44b788025abf49ec89c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:42.764915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b286fb-bb7f-49e6-8d82-3b7a65eb0f0e tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:42.765192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b286fb-bb7f-49e6-8d82-3b7a65eb0f0e tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:42.765460 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b286fb-bb7f-49e6-8d82-3b7a65eb0f0e tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:42.766118 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b286fb-bb7f-49e6-8d82-3b7a65eb0f0e tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:42.768107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b286fb-bb7f-49e6-8d82-3b7a65eb0f0e tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:42.794815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1286/2580] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:42 2022] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:42.798869 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a92d2-2c7b-45a0-914d-cd80b4145df5 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:42.808950 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a92d2-2c7b-45a0-914d-cd80b4145df5 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:42.867322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a05bf5-b6cd-42af-98c9-03f9fa3cb565 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8796ad1243443198717021a38ea0a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23dbb77d6b9d44b788025abf49ec89c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:42.868101 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05bf5-b6cd-42af-98c9-03f9fa3cb565 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:42.868549 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05bf5-b6cd-42af-98c9-03f9fa3cb565 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:42.868909 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05bf5-b6cd-42af-98c9-03f9fa3cb565 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:42.869729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a05bf5-b6cd-42af-98c9-03f9fa3cb565 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:42.870224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a05bf5-b6cd-42af-98c9-03f9fa3cb565 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:42.873097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a05bf5-b6cd-42af-98c9-03f9fa3cb565 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:42.886490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1295/2581] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:28:42.923439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b286fb-bb7f-49e6-8d82-3b7a65eb0f0e tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:42.933572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b286fb-bb7f-49e6-8d82-3b7a65eb0f0e tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:42.938818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8796ad1243443198717021a38ea0a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23dbb77d6b9d44b788025abf49ec89c2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:42.939432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:42.939851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:42.940092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] PATH_INFO: `/v3/projects/61323fa655d547248676f7a4dbe5ee83` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:42.941142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: Authorizing `identity:delete_project(project_id=61323fa655d547248676f7a4dbe5ee83)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:42.943089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:42.991144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61323fa655d547248676f7a4dbe5ee83', 'request_id': 'req-d406aacb-6489-46ef-b9a5-10a800cda985'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:42.998322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61323fa655d547248676f7a4dbe5ee83', 'request_id': 'req-d406aacb-6489-46ef-b9a5-10a800cda985'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:43.006666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61323fa655d547248676f7a4dbe5ee83', 'request_id': 'req-d406aacb-6489-46ef-b9a5-10a800cda985'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:43.018514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] The token cache is being invalidate because project 61323fa655d547248676f7a4dbe5ee83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:43.018745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:43.019393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-d406aacb-6489-46ef-b9a5-10a800cda985 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:43.021567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1287/2582] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:42 2022] DELETE /identity/v3/projects/61323fa655d547248676f7a4dbe5ee83 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:43.213564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a05bf5-b6cd-42af-98c9-03f9fa3cb565 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:43.215306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-50a05bf5-b6cd-42af-98c9-03f9fa3cb565 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:43.268187 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:43.286055 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a05bf5-b6cd-42af-98c9-03f9fa3cb565 tempest-VolumeQuotaClassesTest-1373932487 tempest-VolumeQuotaClassesTest-1373932487-project-admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:43.343486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:43.344116 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:43.344396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:43.344671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] PATH_INFO: `/v3/users/c8e993a944994afc871a31cb678cc023` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:43.345811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e993a944994afc871a31cb678cc023)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:43.348042 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:43.393666 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e993a944994afc871a31cb678cc023'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:43.400487 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e993a944994afc871a31cb678cc023'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:43.412805 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e993a944994afc871a31cb678cc023'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:43.420185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e993a944994afc871a31cb678cc023'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:43.421099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e993a944994afc871a31cb678cc023'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:43.427056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1296/2583] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:43 2022] DELETE /identity/v3/users/c8e993a944994afc871a31cb678cc023 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:43.431646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bf416-9c0f-4f08-85ba-b135286b51d0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:43.431932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bf416-9c0f-4f08-85ba-b135286b51d0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:43.432205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bf416-9c0f-4f08-85ba-b135286b51d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:43.453959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-d08bf416-9c0f-4f08-85ba-b135286b51d0 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:43.455203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d08bf416-9c0f-4f08-85ba-b135286b51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:43.514735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1288/2584] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:43.524673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:43.526193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:43.584306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66068ffa-dca6-4536-b2b2-499f91899456 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:43.587995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4660fab-370f-4bf7-bcb4-180ee0bd62f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:43.588601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4660fab-370f-4bf7-bcb4-180ee0bd62f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:43.588887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4660fab-370f-4bf7-bcb4-180ee0bd62f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:43.589214 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4660fab-370f-4bf7-bcb4-180ee0bd62f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:43.599464 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4660fab-370f-4bf7-bcb4-180ee0bd62f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:43.600904 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4660fab-370f-4bf7-bcb4-180ee0bd62f0 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:43.611563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1297/2585] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:43.895864 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bf416-9c0f-4f08-85ba-b135286b51d0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:43.897673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d08bf416-9c0f-4f08-85ba-b135286b51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:43.912532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bf416-9c0f-4f08-85ba-b135286b51d0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:43.917448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:43.918535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:43.918535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:43.918901 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] PATH_INFO: `/v3/projects/2a726bc180ca411b9e0cfb9191daf366` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:43.920169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a726bc180ca411b9e0cfb9191daf366)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:43.922432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:43.966053 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:43.974418 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a726bc180ca411b9e0cfb9191daf366', 'request_id': 'req-9b8417fd-057f-4d72-a3c1-49a59a51a28e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:43.980633 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a726bc180ca411b9e0cfb9191daf366', 'request_id': 'req-9b8417fd-057f-4d72-a3c1-49a59a51a28e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:43.988178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a726bc180ca411b9e0cfb9191daf366', 'request_id': 'req-9b8417fd-057f-4d72-a3c1-49a59a51a28e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.002257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] The token cache is being invalidate because project 2a726bc180ca411b9e0cfb9191daf366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:44.002623 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.003321 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.005277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1289/2586] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:43 2022] DELETE /identity/v3/projects/2a726bc180ca411b9e0cfb9191daf366 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:28:44.009708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4660fab-370f-4bf7-bcb4-180ee0bd62f0 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:44.021781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4660fab-370f-4bf7-bcb4-180ee0bd62f0 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:44.036402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:44.107430 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a6ebc-6548-4781-bcb2-99408f4f01cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:44.108312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6ebc-6548-4781-bcb2-99408f4f01cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:44.108597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6ebc-6548-4781-bcb2-99408f4f01cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:44.108873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6ebc-6548-4781-bcb2-99408f4f01cd admin admin] PATH_INFO: `/v3/users/b8796ad1243443198717021a38ea0a91` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:44.110047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a6ebc-6548-4781-bcb2-99408f4f01cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8796ad1243443198717021a38ea0a91)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:44.112080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a6ebc-6548-4781-bcb2-99408f4f01cd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:44.163232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-383a6ebc-6548-4781-bcb2-99408f4f01cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8796ad1243443198717021a38ea0a91'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.170470 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-383a6ebc-6548-4781-bcb2-99408f4f01cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8796ad1243443198717021a38ea0a91'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.182576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-383a6ebc-6548-4781-bcb2-99408f4f01cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8796ad1243443198717021a38ea0a91'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.190099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-383a6ebc-6548-4781-bcb2-99408f4f01cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8796ad1243443198717021a38ea0a91'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.190833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-383a6ebc-6548-4781-bcb2-99408f4f01cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8796ad1243443198717021a38ea0a91'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.196581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1298/2587] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:44 2022] DELETE /identity/v3/users/b8796ad1243443198717021a38ea0a91 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:44.483966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:44.486175 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:44.502758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8417fd-057f-4d72-a3c1-49a59a51a28e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:44.564421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:44.565050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:44.565328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:44.565600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] PATH_INFO: `/v3/projects/23dbb77d6b9d44b788025abf49ec89c2` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:44.566735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23dbb77d6b9d44b788025abf49ec89c2)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:44.568740 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:44.620411 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23dbb77d6b9d44b788025abf49ec89c2', 'request_id': 'req-6e6507d4-cabb-449c-b551-2a84aa44ed17'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.626192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23dbb77d6b9d44b788025abf49ec89c2', 'request_id': 'req-6e6507d4-cabb-449c-b551-2a84aa44ed17'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.633919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23dbb77d6b9d44b788025abf49ec89c2', 'request_id': 'req-6e6507d4-cabb-449c-b551-2a84aa44ed17'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.646354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] The token cache is being invalidate because project 23dbb77d6b9d44b788025abf49ec89c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:44.646646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.647290 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6e6507d4-cabb-449c-b551-2a84aa44ed17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:44.648782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1290/2588] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:44 2022] DELETE /identity/v3/projects/23dbb77d6b9d44b788025abf49ec89c2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:28:44.653635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21a84-6db4-4949-a955-733d9867afdf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:44.653919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21a84-6db4-4949-a955-733d9867afdf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:44.654228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd21a84-6db4-4949-a955-733d9867afdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:44.674055 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-edd21a84-6db4-4949-a955-733d9867afdf None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:44.675589 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-edd21a84-6db4-4949-a955-733d9867afdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:44.741123 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1299/2589] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:44.751426 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c563ef9-a9e5-456d-9ca1-2ef5bc76b8fa None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:44.751800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c563ef9-a9e5-456d-9ca1-2ef5bc76b8fa None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:44.752181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c563ef9-a9e5-456d-9ca1-2ef5bc76b8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:44.773669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-2c563ef9-a9e5-456d-9ca1-2ef5bc76b8fa None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:44.774922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-2c563ef9-a9e5-456d-9ca1-2ef5bc76b8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:44.783170 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1291/2590] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:44.787353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd21a84-6db4-4949-a955-733d9867afdf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:44.797343 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd21a84-6db4-4949-a955-733d9867afdf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:44.802325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77804ee-c91c-488c-b219-e01d1bf8b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:44.802933 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77804ee-c91c-488c-b219-e01d1bf8b754 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:44.803209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77804ee-c91c-488c-b219-e01d1bf8b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:44.803479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77804ee-c91c-488c-b219-e01d1bf8b754 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:44.804141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77804ee-c91c-488c-b219-e01d1bf8b754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:44.804421 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77804ee-c91c-488c-b219-e01d1bf8b754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:44.806177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77804ee-c91c-488c-b219-e01d1bf8b754 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:44.818798 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1300/2591] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:28:44.823382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c563ef9-a9e5-456d-9ca1-2ef5bc76b8fa None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:44.835180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c563ef9-a9e5-456d-9ca1-2ef5bc76b8fa None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:44.839811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde4758-9361-429f-ac82-c130139bca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:44.840413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde4758-9361-429f-ac82-c130139bca0d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:44.840687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde4758-9361-429f-ac82-c130139bca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:44.841064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde4758-9361-429f-ac82-c130139bca0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:44.842380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde4758-9361-429f-ac82-c130139bca0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:44.844239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde4758-9361-429f-ac82-c130139bca0d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:44.873800 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1292/2592] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:44 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:44.878115 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77804ee-c91c-488c-b219-e01d1bf8b754 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:44.889175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77804ee-c91c-488c-b219-e01d1bf8b754 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:44.910021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:44.948591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae12a0-e87d-4c11-88a2-d54bbfd90451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:44.949203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae12a0-e87d-4c11-88a2-d54bbfd90451 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:44.949484 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae12a0-e87d-4c11-88a2-d54bbfd90451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:44.949757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae12a0-e87d-4c11-88a2-d54bbfd90451 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:44.950419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae12a0-e87d-4c11-88a2-d54bbfd90451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:44.952849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae12a0-e87d-4c11-88a2-d54bbfd90451 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:44.975476 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1301/2593] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:44 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:44.979918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde4758-9361-429f-ac82-c130139bca0d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:44.993001 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde4758-9361-429f-ac82-c130139bca0d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:44.998260 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5a81d-3d94-434e-b9e4-b73a9482a0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:44.998861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5a81d-3d94-434e-b9e4-b73a9482a0da admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:44.999135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5a81d-3d94-434e-b9e4-b73a9482a0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:44.999405 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5a81d-3d94-434e-b9e4-b73a9482a0da admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:45.000043 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5a81d-3d94-434e-b9e4-b73a9482a0da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:45.001607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5a81d-3d94-434e-b9e4-b73a9482a0da admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:45.012400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1293/2594] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:45.016932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae12a0-e87d-4c11-88a2-d54bbfd90451 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:45.030085 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae12a0-e87d-4c11-88a2-d54bbfd90451 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:45.034711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecee58c-3ebb-4f5d-ad2a-a4b66cb59374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:45.035310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecee58c-3ebb-4f5d-ad2a-a4b66cb59374 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:45.035586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecee58c-3ebb-4f5d-ad2a-a4b66cb59374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:45.035854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecee58c-3ebb-4f5d-ad2a-a4b66cb59374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:45.036494 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecee58c-3ebb-4f5d-ad2a-a4b66cb59374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:45.038098 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecee58c-3ebb-4f5d-ad2a-a4b66cb59374 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:45.048234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1302/2595] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:45.052655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5a81d-3d94-434e-b9e4-b73a9482a0da admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:45.062719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5a81d-3d94-434e-b9e4-b73a9482a0da admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:45.067364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e7a3-4db3-4edd-9c2a-66e491674240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:45.068012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e7a3-4db3-4edd-9c2a-66e491674240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:45.068290 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e7a3-4db3-4edd-9c2a-66e491674240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:45.068928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e7a3-4db3-4edd-9c2a-66e491674240 admin admin] PATH_INFO: `/v3/projects/5790cbcb047b4602b9fd1e1be2e94c27/users/36ff9135fd6d42eeacbecd7349c1dba0/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:45.086052 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421e7a3-4db3-4edd-9c2a-66e491674240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5790cbcb047b4602b9fd1e1be2e94c27, user_id=36ff9135fd6d42eeacbecd7349c1dba0, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:45.088701 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421e7a3-4db3-4edd-9c2a-66e491674240 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:45.090948 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:45.104626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1294/2596] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:45 2022] PUT /identity/v3/projects/5790cbcb047b4602b9fd1e1be2e94c27/users/36ff9135fd6d42eeacbecd7349c1dba0/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:45.116330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce2567-9a54-4143-85cf-52b0d0fb8e54 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:45.116330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce2567-9a54-4143-85cf-52b0d0fb8e54 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:45.116330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce2567-9a54-4143-85cf-52b0d0fb8e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:45.143109 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-4bce2567-9a54-4143-85cf-52b0d0fb8e54 None None] MFA Rules not processed for user `36ff9135fd6d42eeacbecd7349c1dba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:45.144334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-4bce2567-9a54-4143-85cf-52b0d0fb8e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:45.218632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1303/2597] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:45.230873 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e7a3-4db3-4edd-9c2a-66e491674240 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:45.233097 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-d421e7a3-4db3-4edd-9c2a-66e491674240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:45.299397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e7a3-4db3-4edd-9c2a-66e491674240 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:45.303070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c475d29-a7e4-4ff8-842b-475dabbeb85a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:45.303699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c475d29-a7e4-4ff8-842b-475dabbeb85a service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:45.303985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c475d29-a7e4-4ff8-842b-475dabbeb85a service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:45.304261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c475d29-a7e4-4ff8-842b-475dabbeb85a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:45.313345 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c475d29-a7e4-4ff8-842b-475dabbeb85a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:45.314820 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c475d29-a7e4-4ff8-842b-475dabbeb85a service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:45.325184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1295/2598] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:45.345473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce2567-9a54-4143-85cf-52b0d0fb8e54 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:45.415506 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce2567-9a54-4143-85cf-52b0d0fb8e54 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:45.421155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:45.421826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:45.422132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:45.422406 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] PATH_INFO: `/v3/users/36ff9135fd6d42eeacbecd7349c1dba0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:45.423542 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ff9135fd6d42eeacbecd7349c1dba0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:45.425820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:45.469676 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:45.484737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ff9135fd6d42eeacbecd7349c1dba0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:45.494467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ff9135fd6d42eeacbecd7349c1dba0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:45.511607 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ff9135fd6d42eeacbecd7349c1dba0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:45.529501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ff9135fd6d42eeacbecd7349c1dba0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:45.529501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ff9135fd6d42eeacbecd7349c1dba0'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:45.529501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1304/2599] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:45 2022] DELETE /identity/v3/users/36ff9135fd6d42eeacbecd7349c1dba0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:45.538812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2674d0-6263-4772-a9e9-c6cbb479b4e2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:45.539095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2674d0-6263-4772-a9e9-c6cbb479b4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:45.539373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2674d0-6263-4772-a9e9-c6cbb479b4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:45.561967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0d2674d0-6263-4772-a9e9-c6cbb479b4e2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:45.563299 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0d2674d0-6263-4772-a9e9-c6cbb479b4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:45.631931 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1296/2600] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:45.642358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:45.645017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:45.705976 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c5d22-4c96-4701-881c-76281cf0fe40 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:45.709878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f9380-f8e4-4aa2-b5cb-c7e8e55baa24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:45.710716 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f9380-f8e4-4aa2-b5cb-c7e8e55baa24 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:45.711191 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f9380-f8e4-4aa2-b5cb-c7e8e55baa24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:45.711467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f9380-f8e4-4aa2-b5cb-c7e8e55baa24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:45.729741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f9380-f8e4-4aa2-b5cb-c7e8e55baa24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:45.731282 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f9380-f8e4-4aa2-b5cb-c7e8e55baa24 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:45.742097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1305/2601] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:46.039119 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2674d0-6263-4772-a9e9-c6cbb479b4e2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:46.040732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0d2674d0-6263-4772-a9e9-c6cbb479b4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:46.054114 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2674d0-6263-4772-a9e9-c6cbb479b4e2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:46.058687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:46.059323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.059603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.060475 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] PATH_INFO: `/v3/projects/5790cbcb047b4602b9fd1e1be2e94c27` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.061526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5790cbcb047b4602b9fd1e1be2e94c27)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:46.063459 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:46.112397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5790cbcb047b4602b9fd1e1be2e94c27', 'request_id': 'req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:46.117809 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5790cbcb047b4602b9fd1e1be2e94c27', 'request_id': 'req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:46.125781 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5790cbcb047b4602b9fd1e1be2e94c27', 'request_id': 'req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:46.136663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] The token cache is being invalidate because project 5790cbcb047b4602b9fd1e1be2e94c27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:46.136966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:46.137586 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-bdf8e5b5-6ec8-4dd0-b0dd-acff0e85d267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:46.139308 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1297/2602] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:46 2022] DELETE /identity/v3/projects/5790cbcb047b4602b9fd1e1be2e94c27 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:46.145058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a89bba-6a7f-47ca-884b-7aedb2499cd2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.145574 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a89bba-6a7f-47ca-884b-7aedb2499cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.145840 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a89bba-6a7f-47ca-884b-7aedb2499cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.167061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-98a89bba-6a7f-47ca-884b-7aedb2499cd2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:46.168259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-98a89bba-6a7f-47ca-884b-7aedb2499cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:46.226812 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1306/2603] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:46.235145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c09d-ae99-4a54-99aa-64d3bbe7c06f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.235431 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c09d-ae99-4a54-99aa-64d3bbe7c06f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.235702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79c09d-ae99-4a54-99aa-64d3bbe7c06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.255673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-bf79c09d-ae99-4a54-99aa-64d3bbe7c06f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:46.256910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-bf79c09d-ae99-4a54-99aa-64d3bbe7c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:46.264999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1298/2604] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:46.269558 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a89bba-6a7f-47ca-884b-7aedb2499cd2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:46.280091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a89bba-6a7f-47ca-884b-7aedb2499cd2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:46.284947 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24217e5-83a7-4f1b-baba-bd75b7abf0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:46.285578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24217e5-83a7-4f1b-baba-bd75b7abf0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.285855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24217e5-83a7-4f1b-baba-bd75b7abf0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.286163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24217e5-83a7-4f1b-baba-bd75b7abf0b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.286809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24217e5-83a7-4f1b-baba-bd75b7abf0b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:46.287108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24217e5-83a7-4f1b-baba-bd75b7abf0b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:46.288708 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24217e5-83a7-4f1b-baba-bd75b7abf0b5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:46.301135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1307/2605] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:28:46.305421 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79c09d-ae99-4a54-99aa-64d3bbe7c06f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:46.315584 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79c09d-ae99-4a54-99aa-64d3bbe7c06f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:46.320322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2dbb7-8420-42de-ae89-4eca5d729043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:46.320915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2dbb7-8420-42de-ae89-4eca5d729043 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.321199 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2dbb7-8420-42de-ae89-4eca5d729043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.321464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2dbb7-8420-42de-ae89-4eca5d729043 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.322121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2dbb7-8420-42de-ae89-4eca5d729043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:46.323992 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2dbb7-8420-42de-ae89-4eca5d729043 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:46.335779 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:46.353257 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1299/2606] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:46 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:46.358161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24217e5-83a7-4f1b-baba-bd75b7abf0b5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:46.368096 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24217e5-83a7-4f1b-baba-bd75b7abf0b5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:46.408130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:46.427921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbde6c-258c-4c72-9f4c-e123c1595046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:46.428530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbde6c-258c-4c72-9f4c-e123c1595046 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.428808 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbde6c-258c-4c72-9f4c-e123c1595046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.429078 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbde6c-258c-4c72-9f4c-e123c1595046 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.429711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbde6c-258c-4c72-9f4c-e123c1595046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:46.431646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbde6c-258c-4c72-9f4c-e123c1595046 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:46.457963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1308/2607] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:46 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:46.459213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2dbb7-8420-42de-ae89-4eca5d729043 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:46.470532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2dbb7-8420-42de-ae89-4eca5d729043 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:46.475404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ee2a-4969-422a-8219-ff7ceaf06ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:46.475995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ee2a-4969-422a-8219-ff7ceaf06ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.476275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ee2a-4969-422a-8219-ff7ceaf06ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.476546 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ee2a-4969-422a-8219-ff7ceaf06ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.477272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0ee2a-4969-422a-8219-ff7ceaf06ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:46.478859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0ee2a-4969-422a-8219-ff7ceaf06ad6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:46.489518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1300/2608] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:28:46.493499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbde6c-258c-4c72-9f4c-e123c1595046 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:46.504597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbde6c-258c-4c72-9f4c-e123c1595046 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:46.509175 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85126c69-b848-4ad9-b259-4f0d35351fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:46.509758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85126c69-b848-4ad9-b259-4f0d35351fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.510064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85126c69-b848-4ad9-b259-4f0d35351fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.510403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85126c69-b848-4ad9-b259-4f0d35351fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.510951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85126c69-b848-4ad9-b259-4f0d35351fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:46.512538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85126c69-b848-4ad9-b259-4f0d35351fe2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:46.522852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1309/2609] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:46.527140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ee2a-4969-422a-8219-ff7ceaf06ad6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:46.537602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ee2a-4969-422a-8219-ff7ceaf06ad6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:46.542607 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bed44-7a6e-4c4c-97d3-34db3a7f447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:46.543343 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bed44-7a6e-4c4c-97d3-34db3a7f447a admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.543798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bed44-7a6e-4c4c-97d3-34db3a7f447a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.544145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bed44-7a6e-4c4c-97d3-34db3a7f447a admin admin] PATH_INFO: `/v3/projects/80b8285e9ab44675a8fd2e6fc4433dc0/users/ba78902b72954f6a989542116867661e/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.563811 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bed44-7a6e-4c4c-97d3-34db3a7f447a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b8285e9ab44675a8fd2e6fc4433dc0, user_id=ba78902b72954f6a989542116867661e, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:46.566501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bed44-7a6e-4c4c-97d3-34db3a7f447a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:46.591379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1301/2610] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:46 2022] PUT /identity/v3/projects/80b8285e9ab44675a8fd2e6fc4433dc0/users/ba78902b72954f6a989542116867661e/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:46.602384 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd068b0-592e-4df9-8063-9144610adcdf None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.602668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd068b0-592e-4df9-8063-9144610adcdf None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.602940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd068b0-592e-4df9-8063-9144610adcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.634283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3dd068b0-592e-4df9-8063-9144610adcdf None None] MFA Rules not processed for user `ba78902b72954f6a989542116867661e`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:46.635538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3dd068b0-592e-4df9-8063-9144610adcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:46.707450 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1310/2611] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:46.712071 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bed44-7a6e-4c4c-97d3-34db3a7f447a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:46.777670 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bed44-7a6e-4c4c-97d3-34db3a7f447a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:46.783302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d53648-549b-4703-99d3-050eaac67a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:46.783912 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d53648-549b-4703-99d3-050eaac67a32 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.784194 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d53648-549b-4703-99d3-050eaac67a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.784467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d53648-549b-4703-99d3-050eaac67a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.785084 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d53648-549b-4703-99d3-050eaac67a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:46.787002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d53648-549b-4703-99d3-050eaac67a32 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:46.818966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1302/2612] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:46 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:46.823982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd068b0-592e-4df9-8063-9144610adcdf None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:46.842752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd068b0-592e-4df9-8063-9144610adcdf None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:46.916485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21495a-fe1d-4aac-b94b-f722b00a48db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:46.917124 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21495a-fe1d-4aac-b94b-f722b00a48db admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.917404 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21495a-fe1d-4aac-b94b-f722b00a48db admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.917664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21495a-fe1d-4aac-b94b-f722b00a48db admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.918340 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21495a-fe1d-4aac-b94b-f722b00a48db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:46.920283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21495a-fe1d-4aac-b94b-f722b00a48db admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:46.946556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1311/2613] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:46 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:46.951406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d53648-549b-4703-99d3-050eaac67a32 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:46.962963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d53648-549b-4703-99d3-050eaac67a32 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:46.967870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd9c1c-c6e9-413c-a048-7e1a71f2c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:46.968515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9c1c-c6e9-413c-a048-7e1a71f2c9bf admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:46.968802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9c1c-c6e9-413c-a048-7e1a71f2c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:46.969073 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd9c1c-c6e9-413c-a048-7e1a71f2c9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:46.969738 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd9c1c-c6e9-413c-a048-7e1a71f2c9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:46.971642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd9c1c-c6e9-413c-a048-7e1a71f2c9bf admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:46.982861 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1303/2614] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:46.990345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21495a-fe1d-4aac-b94b-f722b00a48db admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:47.001234 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21495a-fe1d-4aac-b94b-f722b00a48db admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:47.005906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe5eff-e7c8-4815-96e1-6ab7b2b8c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:47.006582 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5eff-e7c8-4815-96e1-6ab7b2b8c591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:47.006862 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5eff-e7c8-4815-96e1-6ab7b2b8c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:47.007135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe5eff-e7c8-4815-96e1-6ab7b2b8c591 admin admin] PATH_INFO: `/v3/projects/be8d3d0241c948ef9ae434cd973c45e0/users/6503d63a13964379b6d824b0fd5c85f9/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:47.023619 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe5eff-e7c8-4815-96e1-6ab7b2b8c591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8d3d0241c948ef9ae434cd973c45e0, user_id=6503d63a13964379b6d824b0fd5c85f9, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:47.026764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe5eff-e7c8-4815-96e1-6ab7b2b8c591 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:47.041258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1312/2615] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:46 2022] PUT /identity/v3/projects/be8d3d0241c948ef9ae434cd973c45e0/users/6503d63a13964379b6d824b0fd5c85f9/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:47.045815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd9c1c-c6e9-413c-a048-7e1a71f2c9bf admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:47.056332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd9c1c-c6e9-413c-a048-7e1a71f2c9bf admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:47.127259 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd37c11-de79-45e1-b099-2042d9deeafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:47.127864 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd37c11-de79-45e1-b099-2042d9deeafc admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:47.128138 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd37c11-de79-45e1-b099-2042d9deeafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:47.128407 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd37c11-de79-45e1-b099-2042d9deeafc admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:47.129065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd37c11-de79-45e1-b099-2042d9deeafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:47.130760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd37c11-de79-45e1-b099-2042d9deeafc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:47.141213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1304/2616] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:47.145268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe5eff-e7c8-4815-96e1-6ab7b2b8c591 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:47.158062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe5eff-e7c8-4815-96e1-6ab7b2b8c591 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:47.163023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553e112-1f37-4f1d-a4c4-cefb3b443a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:47.163833 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e112-1f37-4f1d-a4c4-cefb3b443a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:47.164185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e112-1f37-4f1d-a4c4-cefb3b443a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:47.164527 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e112-1f37-4f1d-a4c4-cefb3b443a4b admin admin] PATH_INFO: `/v3/projects/be8d3d0241c948ef9ae434cd973c45e0/users/6503d63a13964379b6d824b0fd5c85f9/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:47.166657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553e112-1f37-4f1d-a4c4-cefb3b443a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8d3d0241c948ef9ae434cd973c45e0, user_id=6503d63a13964379b6d824b0fd5c85f9, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:47.169381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553e112-1f37-4f1d-a4c4-cefb3b443a4b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:47.180124 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1313/2617] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:47 2022] PUT /identity/v3/projects/be8d3d0241c948ef9ae434cd973c45e0/users/6503d63a13964379b6d824b0fd5c85f9/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:28:47.190637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417226f2-bab1-41ce-83c8-704c86a6b97b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:47.191293 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417226f2-bab1-41ce-83c8-704c86a6b97b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:47.191437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417226f2-bab1-41ce-83c8-704c86a6b97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:47.222055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-417226f2-bab1-41ce-83c8-704c86a6b97b None None] MFA Rules not processed for user `6503d63a13964379b6d824b0fd5c85f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:47.223271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-417226f2-bab1-41ce-83c8-704c86a6b97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:47.237491 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:47.304164 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1305/2618] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:47.317732 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553e112-1f37-4f1d-a4c4-cefb3b443a4b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:47.319462 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-0553e112-1f37-4f1d-a4c4-cefb3b443a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:47.324750 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:47.383586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553e112-1f37-4f1d-a4c4-cefb3b443a4b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:47.392646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c8fd9-a4a7-4ce9-806a-8ebf713d6d74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:47.393427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c8fd9-a4a7-4ce9-806a-8ebf713d6d74 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:47.393762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c8fd9-a4a7-4ce9-806a-8ebf713d6d74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:47.394135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c8fd9-a4a7-4ce9-806a-8ebf713d6d74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:47.458980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c8fd9-a4a7-4ce9-806a-8ebf713d6d74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:47.460407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c8fd9-a4a7-4ce9-806a-8ebf713d6d74 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:47.474289 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1314/2619] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:50.044934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417226f2-bab1-41ce-83c8-704c86a6b97b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:50.112797 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417226f2-bab1-41ce-83c8-704c86a6b97b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:50.117323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:50.117947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:50.118254 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:50.118526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] PATH_INFO: `/v3/users/ba78902b72954f6a989542116867661e` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:50.119632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba78902b72954f6a989542116867661e)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:50.121563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:50.167947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba78902b72954f6a989542116867661e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.168728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba78902b72954f6a989542116867661e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.169428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba78902b72954f6a989542116867661e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.176476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba78902b72954f6a989542116867661e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.183363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba78902b72954f6a989542116867661e'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.202289 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1306/2620] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:50 2022] DELETE /identity/v3/users/ba78902b72954f6a989542116867661e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:50.206740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0dad9-0cbd-43d3-ab36-6457900dbda6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:50.207204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0dad9-0cbd-43d3-ab36-6457900dbda6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:50.207325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0dad9-0cbd-43d3-ab36-6457900dbda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:50.228449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3bf0dad9-0cbd-43d3-ab36-6457900dbda6 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:50.229660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3bf0dad9-0cbd-43d3-ab36-6457900dbda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:50.292262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1315/2621] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:50.302600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:50.304069 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:50.340158 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:50.363808 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf40e9-79dc-4ab2-8609-7ead5510adae admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:50.367461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f18483-a392-48c1-b18c-4e697f5983ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:50.368058 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f18483-a392-48c1-b18c-4e697f5983ea service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:50.368337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f18483-a392-48c1-b18c-4e697f5983ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:50.368610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f18483-a392-48c1-b18c-4e697f5983ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:50.379936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f18483-a392-48c1-b18c-4e697f5983ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:50.381392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f18483-a392-48c1-b18c-4e697f5983ea service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:50.391651 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1307/2622] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:50.674810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0dad9-0cbd-43d3-ab36-6457900dbda6 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:50.676245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3bf0dad9-0cbd-43d3-ab36-6457900dbda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:50.688868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0dad9-0cbd-43d3-ab36-6457900dbda6 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:50.697514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:50.697514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:50.697514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:50.697514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] PATH_INFO: `/v3/projects/80b8285e9ab44675a8fd2e6fc4433dc0` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:50.698014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b8285e9ab44675a8fd2e6fc4433dc0)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:50.699952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:50.749735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b8285e9ab44675a8fd2e6fc4433dc0', 'request_id': 'req-35effca2-b897-4177-a804-56e47cd197cf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.752185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:50.757118 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b8285e9ab44675a8fd2e6fc4433dc0', 'request_id': 'req-35effca2-b897-4177-a804-56e47cd197cf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.764197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b8285e9ab44675a8fd2e6fc4433dc0', 'request_id': 'req-35effca2-b897-4177-a804-56e47cd197cf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.775445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] The token cache is being invalidate because project 80b8285e9ab44675a8fd2e6fc4433dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:50.775728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.776353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.777841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1316/2623] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:50 2022] DELETE /identity/v3/projects/80b8285e9ab44675a8fd2e6fc4433dc0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:50.782581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f18483-a392-48c1-b18c-4e697f5983ea service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:50.792010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f18483-a392-48c1-b18c-4e697f5983ea service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:50.849377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8737d-cc34-4936-b607-528274bd659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:50.849936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8737d-cc34-4936-b607-528274bd659a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:50.850253 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8737d-cc34-4936-b607-528274bd659a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:50.850530 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8737d-cc34-4936-b607-528274bd659a admin admin] PATH_INFO: `/v3/users/6503d63a13964379b6d824b0fd5c85f9` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:50.851702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8737d-cc34-4936-b607-528274bd659a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6503d63a13964379b6d824b0fd5c85f9)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:50.853617 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8737d-cc34-4936-b607-528274bd659a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:50.899760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6da8737d-cc34-4936-b607-528274bd659a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6503d63a13964379b6d824b0fd5c85f9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.900412 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6da8737d-cc34-4936-b607-528274bd659a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6503d63a13964379b6d824b0fd5c85f9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.901200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6da8737d-cc34-4936-b607-528274bd659a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6503d63a13964379b6d824b0fd5c85f9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.910155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6da8737d-cc34-4936-b607-528274bd659a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6503d63a13964379b6d824b0fd5c85f9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.910300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:50.913271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:50.918427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-6da8737d-cc34-4936-b607-528274bd659a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6503d63a13964379b6d824b0fd5c85f9'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.926747 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35effca2-b897-4177-a804-56e47cd197cf admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:50.931607 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:50.932253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:50.932512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:50.932783 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] PATH_INFO: `/v3/users/d0eabb76df3242d5a237a4dd49031cbf` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:50.934150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0eabb76df3242d5a237a4dd49031cbf)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:50.936075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:50.939108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1308/2624] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:50 2022] DELETE /identity/v3/users/6503d63a13964379b6d824b0fd5c85f9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:50.986400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0eabb76df3242d5a237a4dd49031cbf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:50.993966 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0eabb76df3242d5a237a4dd49031cbf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.007068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0eabb76df3242d5a237a4dd49031cbf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.013958 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0eabb76df3242d5a237a4dd49031cbf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.015243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0eabb76df3242d5a237a4dd49031cbf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.021411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1317/2625] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:50 2022] DELETE /identity/v3/users/d0eabb76df3242d5a237a4dd49031cbf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:51.026589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540de2f1-12ca-4c87-8e6a-559a6d84089b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.027009 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540de2f1-12ca-4c87-8e6a-559a6d84089b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.027354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540de2f1-12ca-4c87-8e6a-559a6d84089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.047614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-540de2f1-12ca-4c87-8e6a-559a6d84089b None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:51.048916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-540de2f1-12ca-4c87-8e6a-559a6d84089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:51.105807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:51.125166 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1309/2626] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:51.132130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.133593 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:51.193498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261608dc-bb12-4145-8075-e8f5a043bfce admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.197153 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389f7c-d695-4103-ae8e-92533e16f8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.197760 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389f7c-d695-4103-ae8e-92533e16f8bb service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.198065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389f7c-d695-4103-ae8e-92533e16f8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.198345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389f7c-d695-4103-ae8e-92533e16f8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.208162 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389f7c-d695-4103-ae8e-92533e16f8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.209596 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389f7c-d695-4103-ae8e-92533e16f8bb service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.220668 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1318/2627] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:51.240195 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540de2f1-12ca-4c87-8e6a-559a6d84089b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.241832 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-540de2f1-12ca-4c87-8e6a-559a6d84089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:51.267180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540de2f1-12ca-4c87-8e6a-559a6d84089b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.272391 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.273287 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.273634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.274237 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] PATH_INFO: `/v3/projects/be8d3d0241c948ef9ae434cd973c45e0` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.275194 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8d3d0241c948ef9ae434cd973c45e0)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.277330 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.330630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8d3d0241c948ef9ae434cd973c45e0', 'request_id': 'req-c8611c2d-df7f-49c0-918e-79699db5c85f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.336848 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8d3d0241c948ef9ae434cd973c45e0', 'request_id': 'req-c8611c2d-df7f-49c0-918e-79699db5c85f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.344139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8d3d0241c948ef9ae434cd973c45e0', 'request_id': 'req-c8611c2d-df7f-49c0-918e-79699db5c85f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.355630 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] The token cache is being invalidate because project be8d3d0241c948ef9ae434cd973c45e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:51.355970 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.356558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-c8611c2d-df7f-49c0-918e-79699db5c85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.358048 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1310/2628] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:51 2022] DELETE /identity/v3/projects/be8d3d0241c948ef9ae434cd973c45e0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:51.362967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb4989-542f-4709-a884-39b9579b8c36 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.363370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb4989-542f-4709-a884-39b9579b8c36 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.363735 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb4989-542f-4709-a884-39b9579b8c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.386063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-98cb4989-542f-4709-a884-39b9579b8c36 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:51.387311 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-98cb4989-542f-4709-a884-39b9579b8c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:51.440837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:51.457998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1319/2629] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:51.466634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d5d3-6205-424e-bb25-069efe91d1d9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.467105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d5d3-6205-424e-bb25-069efe91d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.468035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274d5d3-6205-424e-bb25-069efe91d1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.489851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9274d5d3-6205-424e-bb25-069efe91d1d9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:51.491349 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9274d5d3-6205-424e-bb25-069efe91d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:51.501581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1311/2630] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:51.506015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb4989-542f-4709-a884-39b9579b8c36 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.507980 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274d5d3-6205-424e-bb25-069efe91d1d9 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.509835 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9274d5d3-6205-424e-bb25-069efe91d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:51.516353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb4989-542f-4709-a884-39b9579b8c36 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.521664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b916-e3cd-4142-bcbc-fcc4519dd372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.522224 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b916-e3cd-4142-bcbc-fcc4519dd372 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.522525 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b916-e3cd-4142-bcbc-fcc4519dd372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.522782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b916-e3cd-4142-bcbc-fcc4519dd372 admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.523439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b916-e3cd-4142-bcbc-fcc4519dd372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:51.523748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b916-e3cd-4142-bcbc-fcc4519dd372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.525420 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67b916-e3cd-4142-bcbc-fcc4519dd372 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.529711 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274d5d3-6205-424e-bb25-069efe91d1d9 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.536657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.537368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.537565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.537831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] PATH_INFO: `/v3/projects/28633bc6899944e38fdbe9c98402b884` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.539020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=28633bc6899944e38fdbe9c98402b884)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.541012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.541325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1320/2631] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:28:51.545671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b916-e3cd-4142-bcbc-fcc4519dd372 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.556414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b916-e3cd-4142-bcbc-fcc4519dd372 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.561884 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30301f-e921-4b4f-b911-9666df3e8dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.562627 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30301f-e921-4b4f-b911-9666df3e8dba admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.563147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30301f-e921-4b4f-b911-9666df3e8dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.563488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30301f-e921-4b4f-b911-9666df3e8dba admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.564186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30301f-e921-4b4f-b911-9666df3e8dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.566246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30301f-e921-4b4f-b911-9666df3e8dba admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.595307 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1321/2632] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:51 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:51.595704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28633bc6899944e38fdbe9c98402b884', 'request_id': 'req-36ff3167-df02-405c-acb8-75a1ca2791cc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.600341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30301f-e921-4b4f-b911-9666df3e8dba admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.601827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28633bc6899944e38fdbe9c98402b884', 'request_id': 'req-36ff3167-df02-405c-acb8-75a1ca2791cc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.609551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28633bc6899944e38fdbe9c98402b884', 'request_id': 'req-36ff3167-df02-405c-acb8-75a1ca2791cc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.620858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] The token cache is being invalidate because project 28633bc6899944e38fdbe9c98402b884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:51.621143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.621795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-36ff3167-df02-405c-acb8-75a1ca2791cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:51.623294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1312/2633] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:51 2022] DELETE /identity/v3/projects/28633bc6899944e38fdbe9c98402b884 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:51.628467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b67e51-5c76-4877-a560-06fa726c0ef9 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.628751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b67e51-5c76-4877-a560-06fa726c0ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.629026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b67e51-5c76-4877-a560-06fa726c0ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.647999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-07b67e51-5c76-4877-a560-06fa726c0ef9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:51.649200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-07b67e51-5c76-4877-a560-06fa726c0ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:51.663283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30301f-e921-4b4f-b911-9666df3e8dba admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.667985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0ce3a-1c90-47fd-b11b-60d11f03fbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.668598 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0ce3a-1c90-47fd-b11b-60d11f03fbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.668879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0ce3a-1c90-47fd-b11b-60d11f03fbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.669149 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0ce3a-1c90-47fd-b11b-60d11f03fbd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.669769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0ce3a-1c90-47fd-b11b-60d11f03fbd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.672232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0ce3a-1c90-47fd-b11b-60d11f03fbd2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.695410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1322/2634] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:51 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:51.698628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:51.699341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0ce3a-1c90-47fd-b11b-60d11f03fbd2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.701403 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3ef0ce3a-1c90-47fd-b11b-60d11f03fbd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:51.713379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1313/2635] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:51.714878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0ce3a-1c90-47fd-b11b-60d11f03fbd2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.719723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf650-6e8a-4a9f-b575-681616133124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.720324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf650-6e8a-4a9f-b575-681616133124 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.720601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf650-6e8a-4a9f-b575-681616133124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.720873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaf650-6e8a-4a9f-b575-681616133124 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.721611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e000f9-0493-4391-98a9-a5be111c5055 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.721775 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaf650-6e8a-4a9f-b575-681616133124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.721899 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e000f9-0493-4391-98a9-a5be111c5055 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.722213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e000f9-0493-4391-98a9-a5be111c5055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.723395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaf650-6e8a-4a9f-b575-681616133124 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.737066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1323/2636] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:28:51.738008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf650-6e8a-4a9f-b575-681616133124 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.743238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-93e000f9-0493-4391-98a9-a5be111c5055 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:51.744472 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-93e000f9-0493-4391-98a9-a5be111c5055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:51.747448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaf650-6e8a-4a9f-b575-681616133124 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.752652 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f0248-a305-42a7-9e0a-e5c75a427df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.752894 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1314/2637] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:51.753285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f0248-a305-42a7-9e0a-e5c75a427df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.753568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f0248-a305-42a7-9e0a-e5c75a427df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.753839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f0248-a305-42a7-9e0a-e5c75a427df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.754494 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f0248-a305-42a7-9e0a-e5c75a427df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.756065 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f0248-a305-42a7-9e0a-e5c75a427df9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.756842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e000f9-0493-4391-98a9-a5be111c5055 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.765655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e000f9-0493-4391-98a9-a5be111c5055 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.769906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1324/2638] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:51.771074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5594b-201c-4993-8d01-f5efda24d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.771325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f0248-a305-42a7-9e0a-e5c75a427df9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.771691 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5594b-201c-4993-8d01-f5efda24d58e admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.771969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5594b-201c-4993-8d01-f5efda24d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.772260 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5594b-201c-4993-8d01-f5efda24d58e admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.772903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5594b-201c-4993-8d01-f5efda24d58e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:51.773202 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5594b-201c-4993-8d01-f5efda24d58e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.774824 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f5594b-201c-4993-8d01-f5efda24d58e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.780971 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f0248-a305-42a7-9e0a-e5c75a427df9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.785570 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed910bb-4636-4496-a44a-d27826f655d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.786242 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed910bb-4636-4496-a44a-d27826f655d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.786521 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed910bb-4636-4496-a44a-d27826f655d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.786788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed910bb-4636-4496-a44a-d27826f655d9 admin admin] PATH_INFO: `/v3/projects/8d57568c22794ee99a287ecdc2302151/users/9414b728c6f54c9f94cd75196018f2bb/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.787086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1315/2639] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:28:51.791301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5594b-201c-4993-8d01-f5efda24d58e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.801412 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5594b-201c-4993-8d01-f5efda24d58e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.803283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed910bb-4636-4496-a44a-d27826f655d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d57568c22794ee99a287ecdc2302151, user_id=9414b728c6f54c9f94cd75196018f2bb, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.805922 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed910bb-4636-4496-a44a-d27826f655d9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.806188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3a25-3164-437a-a82e-a5c45af48c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.806783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3a25-3164-437a-a82e-a5c45af48c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.807057 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3a25-3164-437a-a82e-a5c45af48c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.807442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3a25-3164-437a-a82e-a5c45af48c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.808097 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3a25-3164-437a-a82e-a5c45af48c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.810178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3a25-3164-437a-a82e-a5c45af48c29 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.820095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1325/2640] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:51 2022] PUT /identity/v3/projects/8d57568c22794ee99a287ecdc2302151/users/9414b728c6f54c9f94cd75196018f2bb/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:51.832121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd16007-3e70-4642-90c5-8983e7113a6f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.832426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd16007-3e70-4642-90c5-8983e7113a6f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.832963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd16007-3e70-4642-90c5-8983e7113a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.845128 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1316/2641] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:51 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:51.846452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3a25-3164-437a-a82e-a5c45af48c29 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.862860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-2bd16007-3e70-4642-90c5-8983e7113a6f None None] MFA Rules not processed for user `9414b728c6f54c9f94cd75196018f2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:51.864014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2bd16007-3e70-4642-90c5-8983e7113a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:51.911219 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3a25-3164-437a-a82e-a5c45af48c29 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.916184 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efaae0-8660-4cdc-a93e-f0f9f2cab67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.916788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efaae0-8660-4cdc-a93e-f0f9f2cab67e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.917066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efaae0-8660-4cdc-a93e-f0f9f2cab67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.917338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efaae0-8660-4cdc-a93e-f0f9f2cab67e admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.917956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efaae0-8660-4cdc-a93e-f0f9f2cab67e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.919914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efaae0-8660-4cdc-a93e-f0f9f2cab67e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.920433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:51.932285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1326/2642] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:51.944276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1317/2643] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:51 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:51.944452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd16007-3e70-4642-90c5-8983e7113a6f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.944918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-2bd16007-3e70-4642-90c5-8983e7113a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:51.945265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efaae0-8660-4cdc-a93e-f0f9f2cab67e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.955713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efaae0-8660-4cdc-a93e-f0f9f2cab67e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.960529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e6510-ac47-4966-a8c7-5f49d1617a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.961231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e6510-ac47-4966-a8c7-5f49d1617a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.961515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e6510-ac47-4966-a8c7-5f49d1617a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.961788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e6510-ac47-4966-a8c7-5f49d1617a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.962535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e6510-ac47-4966-a8c7-5f49d1617a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.964105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e6510-ac47-4966-a8c7-5f49d1617a38 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:51.974782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1318/2644] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:51.978590 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e6510-ac47-4966-a8c7-5f49d1617a38 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:51.987842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e6510-ac47-4966-a8c7-5f49d1617a38 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:51.992442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c876ec-055b-4dfe-b0ab-8078ec22c09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:51.993035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c876ec-055b-4dfe-b0ab-8078ec22c09a admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:51.993311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c876ec-055b-4dfe-b0ab-8078ec22c09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:51.993588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c876ec-055b-4dfe-b0ab-8078ec22c09a admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:51.994243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c876ec-055b-4dfe-b0ab-8078ec22c09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:51.995980 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c876ec-055b-4dfe-b0ab-8078ec22c09a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:52.005319 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd16007-3e70-4642-90c5-8983e7113a6f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:52.006765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1319/2645] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:28:52.009405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65794698-9c8a-4609-87f0-27b3267b4282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:52.010220 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794698-9c8a-4609-87f0-27b3267b4282 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.010505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794698-9c8a-4609-87f0-27b3267b4282 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.010805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c876ec-055b-4dfe-b0ab-8078ec22c09a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:52.010929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65794698-9c8a-4609-87f0-27b3267b4282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.019887 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65794698-9c8a-4609-87f0-27b3267b4282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:52.021309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65794698-9c8a-4609-87f0-27b3267b4282 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:52.021439 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c876ec-055b-4dfe-b0ab-8078ec22c09a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:52.026081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19c337-b820-4af3-b605-838746c93fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:52.026792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19c337-b820-4af3-b605-838746c93fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.027208 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19c337-b820-4af3-b605-838746c93fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.027523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19c337-b820-4af3-b605-838746c93fc3 admin admin] PATH_INFO: `/v3/projects/a694c17874b84dbd821dedc7fc98d238/users/204102708aa04aa6b171822b9f67c940/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.030085 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1327/2646] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:52.042302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19c337-b820-4af3-b605-838746c93fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a694c17874b84dbd821dedc7fc98d238, user_id=204102708aa04aa6b171822b9f67c940, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:52.044937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19c337-b820-4af3-b605-838746c93fc3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:52.059006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1320/2647] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:52 2022] PUT /identity/v3/projects/a694c17874b84dbd821dedc7fc98d238/users/204102708aa04aa6b171822b9f67c940/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:28:52.070248 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad93cc-4a66-468f-b0a7-d693b2a0b430 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.070613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad93cc-4a66-468f-b0a7-d693b2a0b430 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.070890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad93cc-4a66-468f-b0a7-d693b2a0b430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.100187 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-86ad93cc-4a66-468f-b0a7-d693b2a0b430 None None] MFA Rules not processed for user `204102708aa04aa6b171822b9f67c940`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:52.101404 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-86ad93cc-4a66-468f-b0a7-d693b2a0b430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:52.179179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1328/2648] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:52.183849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19c337-b820-4af3-b605-838746c93fc3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:52.242094 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:52.248581 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19c337-b820-4af3-b605-838746c93fc3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:52.254816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75c283-7450-428e-ba76-3bee803be6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:52.255424 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c283-7450-428e-ba76-3bee803be6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.255702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c283-7450-428e-ba76-3bee803be6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.256162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75c283-7450-428e-ba76-3bee803be6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.256612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75c283-7450-428e-ba76-3bee803be6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:52.258640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75c283-7450-428e-ba76-3bee803be6b3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:52.285659 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1321/2649] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:52 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:52.289910 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad93cc-4a66-468f-b0a7-d693b2a0b430 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:52.301195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad93cc-4a66-468f-b0a7-d693b2a0b430 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:52.375093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac64859-5696-45fd-9cf8-ed4370ae8f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:52.375633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64859-5696-45fd-9cf8-ed4370ae8f39 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.375913 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64859-5696-45fd-9cf8-ed4370ae8f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.376185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac64859-5696-45fd-9cf8-ed4370ae8f39 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.377380 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac64859-5696-45fd-9cf8-ed4370ae8f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:52.378728 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac64859-5696-45fd-9cf8-ed4370ae8f39 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:52.401324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1329/2650] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:52 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:52.405328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75c283-7450-428e-ba76-3bee803be6b3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:52.415948 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75c283-7450-428e-ba76-3bee803be6b3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:52.421874 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190fb33-55db-4995-bed7-65958bcbe203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:52.422604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190fb33-55db-4995-bed7-65958bcbe203 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.422966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190fb33-55db-4995-bed7-65958bcbe203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.423312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190fb33-55db-4995-bed7-65958bcbe203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.424061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190fb33-55db-4995-bed7-65958bcbe203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:52.425709 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190fb33-55db-4995-bed7-65958bcbe203 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:52.437567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1322/2651] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:28:52.442297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac64859-5696-45fd-9cf8-ed4370ae8f39 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:52.452989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac64859-5696-45fd-9cf8-ed4370ae8f39 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:52.457837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f0bf7-b6b5-440f-8b10-d2e1b1018685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:52.458523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f0bf7-b6b5-440f-8b10-d2e1b1018685 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.458811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f0bf7-b6b5-440f-8b10-d2e1b1018685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.459088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f0bf7-b6b5-440f-8b10-d2e1b1018685 admin admin] PATH_INFO: `/v3/projects/4828f6af42524f02bbc63b20f295aa87/users/b7f6b98d81ba4a398a6862fea38f11f7/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.472141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:52.475891 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f0bf7-b6b5-440f-8b10-d2e1b1018685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4828f6af42524f02bbc63b20f295aa87, user_id=b7f6b98d81ba4a398a6862fea38f11f7, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:52.479195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f0bf7-b6b5-440f-8b10-d2e1b1018685 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:52.492482 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1330/2652] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:52 2022] PUT /identity/v3/projects/4828f6af42524f02bbc63b20f295aa87/users/b7f6b98d81ba4a398a6862fea38f11f7/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:52.496663 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190fb33-55db-4995-bed7-65958bcbe203 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:52.507209 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190fb33-55db-4995-bed7-65958bcbe203 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:52.563594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b638eb-3906-4b87-9f6c-91528d17b43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:52.564208 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b638eb-3906-4b87-9f6c-91528d17b43d admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.564493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b638eb-3906-4b87-9f6c-91528d17b43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.564766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b638eb-3906-4b87-9f6c-91528d17b43d admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.565413 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b638eb-3906-4b87-9f6c-91528d17b43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:52.567043 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b638eb-3906-4b87-9f6c-91528d17b43d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:52.576826 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1323/2653] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:52.581074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f0bf7-b6b5-440f-8b10-d2e1b1018685 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:52.591399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f0bf7-b6b5-440f-8b10-d2e1b1018685 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:52.595974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b64c-3a96-4197-8bd8-2260cbac6ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:52.596879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b64c-3a96-4197-8bd8-2260cbac6ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.597158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b64c-3a96-4197-8bd8-2260cbac6ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.597431 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b64c-3a96-4197-8bd8-2260cbac6ba2 admin admin] PATH_INFO: `/v3/projects/4828f6af42524f02bbc63b20f295aa87/users/b7f6b98d81ba4a398a6862fea38f11f7/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.599369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19b64c-3a96-4197-8bd8-2260cbac6ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4828f6af42524f02bbc63b20f295aa87, user_id=b7f6b98d81ba4a398a6862fea38f11f7, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:52.602159 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19b64c-3a96-4197-8bd8-2260cbac6ba2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:52.612972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1331/2654] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:52 2022] PUT /identity/v3/projects/4828f6af42524f02bbc63b20f295aa87/users/b7f6b98d81ba4a398a6862fea38f11f7/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:52.625006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7ef54-97f7-412b-9a0d-fb23d5b1879d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.625350 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7ef54-97f7-412b-9a0d-fb23d5b1879d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.625570 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7ef54-97f7-412b-9a0d-fb23d5b1879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.652788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-6ef7ef54-97f7-412b-9a0d-fb23d5b1879d None None] MFA Rules not processed for user `b7f6b98d81ba4a398a6862fea38f11f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:52.654015 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6ef7ef54-97f7-412b-9a0d-fb23d5b1879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:52.723338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1324/2655] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:52.735455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b64c-3a96-4197-8bd8-2260cbac6ba2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:52.737153 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-fd19b64c-3a96-4197-8bd8-2260cbac6ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:52.792660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b64c-3a96-4197-8bd8-2260cbac6ba2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:52.796855 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130fda2-cb48-4eb9-a086-fb710a617d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:52.797451 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130fda2-cb48-4eb9-a086-fb710a617d49 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.797730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130fda2-cb48-4eb9-a086-fb710a617d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.798003 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130fda2-cb48-4eb9-a086-fb710a617d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.806895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130fda2-cb48-4eb9-a086-fb710a617d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:52.808316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130fda2-cb48-4eb9-a086-fb710a617d49 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:52.818634 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1332/2656] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:52.893144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7ef54-97f7-412b-9a0d-fb23d5b1879d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:52.903089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7ef54-97f7-412b-9a0d-fb23d5b1879d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:52.907412 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeda03-4fd1-434a-8081-80bdf6571318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:52.908016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeda03-4fd1-434a-8081-80bdf6571318 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:52.908298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeda03-4fd1-434a-8081-80bdf6571318 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:52.908566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeda03-4fd1-434a-8081-80bdf6571318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:52.956017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:52.966666 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeda03-4fd1-434a-8081-80bdf6571318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:52.968602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeda03-4fd1-434a-8081-80bdf6571318 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:52.977693 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1325/2657] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:55.709858 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130fda2-cb48-4eb9-a086-fb710a617d49 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:55.772008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130fda2-cb48-4eb9-a086-fb710a617d49 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:55.776571 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:55.777201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:55.777489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:55.777759 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] PATH_INFO: `/v3/users/204102708aa04aa6b171822b9f67c940` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:55.779013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=204102708aa04aa6b171822b9f67c940)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:55.781438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:55.831562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204102708aa04aa6b171822b9f67c940'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:55.839658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204102708aa04aa6b171822b9f67c940'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:55.854498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204102708aa04aa6b171822b9f67c940'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:55.865290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204102708aa04aa6b171822b9f67c940'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:55.865898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204102708aa04aa6b171822b9f67c940'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:55.868075 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:55.873184 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1333/2658] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:55 2022] DELETE /identity/v3/users/204102708aa04aa6b171822b9f67c940 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:55.877794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789ac64-40d6-4e39-96f2-9afde2006b1c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:55.878358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789ac64-40d6-4e39-96f2-9afde2006b1c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:55.878358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789ac64-40d6-4e39-96f2-9afde2006b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:55.897109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-e789ac64-40d6-4e39-96f2-9afde2006b1c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:55.898337 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e789ac64-40d6-4e39-96f2-9afde2006b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:55.962362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1326/2659] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:28:55.974683 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:55.976122 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:56.035787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6db1-1834-4ece-acf0-e0986239d442 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:56.039478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e45ab-15d7-4e32-a40c-0331e800ea6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:56.040087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e45ab-15d7-4e32-a40c-0331e800ea6f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:56.040367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e45ab-15d7-4e32-a40c-0331e800ea6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:56.040643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e45ab-15d7-4e32-a40c-0331e800ea6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:56.049914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e45ab-15d7-4e32-a40c-0331e800ea6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:56.051443 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e45ab-15d7-4e32-a40c-0331e800ea6f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:56.061957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1334/2660] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:56.354571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789ac64-40d6-4e39-96f2-9afde2006b1c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:56.356279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-e789ac64-40d6-4e39-96f2-9afde2006b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:56.369774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789ac64-40d6-4e39-96f2-9afde2006b1c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:56.377298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:56.377955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:56.378266 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:56.378540 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] PATH_INFO: `/v3/projects/a694c17874b84dbd821dedc7fc98d238` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:56.379697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a694c17874b84dbd821dedc7fc98d238)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:56.381611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:56.432871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a694c17874b84dbd821dedc7fc98d238', 'request_id': 'req-ef396814-d62d-497f-843d-5d4edc6329c6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:56.439634 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a694c17874b84dbd821dedc7fc98d238', 'request_id': 'req-ef396814-d62d-497f-843d-5d4edc6329c6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:56.449360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a694c17874b84dbd821dedc7fc98d238', 'request_id': 'req-ef396814-d62d-497f-843d-5d4edc6329c6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:56.461810 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] The token cache is being invalidate because project a694c17874b84dbd821dedc7fc98d238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:56.462142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:56.462821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:56.464311 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1327/2661] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:56 2022] DELETE /identity/v3/projects/a694c17874b84dbd821dedc7fc98d238 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:56.468839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e45ab-15d7-4e32-a40c-0331e800ea6f service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:56.479039 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e45ab-15d7-4e32-a40c-0331e800ea6f service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:56.537084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b33284-3234-453b-a94e-5a4fe12e523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:56.537718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b33284-3234-453b-a94e-5a4fe12e523e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:56.538000 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b33284-3234-453b-a94e-5a4fe12e523e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:56.538306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b33284-3234-453b-a94e-5a4fe12e523e admin admin] PATH_INFO: `/v3/users/b7f6b98d81ba4a398a6862fea38f11f7` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:56.539488 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b33284-3234-453b-a94e-5a4fe12e523e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f6b98d81ba4a398a6862fea38f11f7)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:56.541419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b33284-3234-453b-a94e-5a4fe12e523e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:56.597134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a2b33284-3234-453b-a94e-5a4fe12e523e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f6b98d81ba4a398a6862fea38f11f7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:56.604095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a2b33284-3234-453b-a94e-5a4fe12e523e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f6b98d81ba4a398a6862fea38f11f7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:56.616186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a2b33284-3234-453b-a94e-5a4fe12e523e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f6b98d81ba4a398a6862fea38f11f7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:56.622816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a2b33284-3234-453b-a94e-5a4fe12e523e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f6b98d81ba4a398a6862fea38f11f7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:56.623501 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a2b33284-3234-453b-a94e-5a4fe12e523e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f6b98d81ba4a398a6862fea38f11f7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:56.630245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1335/2662] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:56 2022] DELETE /identity/v3/users/b7f6b98d81ba4a398a6862fea38f11f7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:56.933789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:56.935609 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:56.960672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef396814-d62d-497f-843d-5d4edc6329c6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:57.023022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:57.023336 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.023656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.023933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] PATH_INFO: `/v3/projects/4828f6af42524f02bbc63b20f295aa87` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.025245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4828f6af42524f02bbc63b20f295aa87)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:57.027362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:57.044545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:57.091774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4828f6af42524f02bbc63b20f295aa87', 'request_id': 'req-3aab2d98-303e-4424-b9b9-170e95e56c61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:57.098493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4828f6af42524f02bbc63b20f295aa87', 'request_id': 'req-3aab2d98-303e-4424-b9b9-170e95e56c61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:57.107830 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4828f6af42524f02bbc63b20f295aa87', 'request_id': 'req-3aab2d98-303e-4424-b9b9-170e95e56c61'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:57.122425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] The token cache is being invalidate because project 4828f6af42524f02bbc63b20f295aa87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:28:57.122807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:57.123717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-3aab2d98-303e-4424-b9b9-170e95e56c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:57.126020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1328/2663] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:28:56 2022] DELETE /identity/v3/projects/4828f6af42524f02bbc63b20f295aa87 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:57.137463 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17610698-5cec-4f6c-abb0-bff106906ec8 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.138494 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17610698-5cec-4f6c-abb0-bff106906ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.139013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17610698-5cec-4f6c-abb0-bff106906ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.167890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-17610698-5cec-4f6c-abb0-bff106906ec8 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:57.169290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-17610698-5cec-4f6c-abb0-bff106906ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:57.192568 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:57.261118 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1336/2664] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:57.263537 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4408a-4594-43c9-8e4b-f1988812826f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.263898 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4408a-4594-43c9-8e4b-f1988812826f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.264297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4408a-4594-43c9-8e4b-f1988812826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.288998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9fc4408a-4594-43c9-8e4b-f1988812826f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:57.290419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9fc4408a-4594-43c9-8e4b-f1988812826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:57.304370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1329/2665] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:57.305179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17610698-5cec-4f6c-abb0-bff106906ec8 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:57.324611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17610698-5cec-4f6c-abb0-bff106906ec8 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:57.324611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261794a1-a838-4a10-b38b-6dc01544c5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:57.324611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261794a1-a838-4a10-b38b-6dc01544c5fa admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.324611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261794a1-a838-4a10-b38b-6dc01544c5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.324986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261794a1-a838-4a10-b38b-6dc01544c5fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.324986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261794a1-a838-4a10-b38b-6dc01544c5fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:28:57.324986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261794a1-a838-4a10-b38b-6dc01544c5fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:57.326142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261794a1-a838-4a10-b38b-6dc01544c5fa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:57.349771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1337/2666] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:28:57.350949 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4408a-4594-43c9-8e4b-f1988812826f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:57.360571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4408a-4594-43c9-8e4b-f1988812826f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:57.366904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e77a3-2452-4d9b-aeff-bae16651b8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:57.367621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e77a3-2452-4d9b-aeff-bae16651b8fd admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.368017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e77a3-2452-4d9b-aeff-bae16651b8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.368514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e77a3-2452-4d9b-aeff-bae16651b8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.369236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e77a3-2452-4d9b-aeff-bae16651b8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:57.371262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e77a3-2452-4d9b-aeff-bae16651b8fd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:57.407699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1330/2667] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:57 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:57.407816 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261794a1-a838-4a10-b38b-6dc01544c5fa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:57.418261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261794a1-a838-4a10-b38b-6dc01544c5fa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:57.488786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed1946-81ed-420f-bbb2-b04b55f35289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:57.489484 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed1946-81ed-420f-bbb2-b04b55f35289 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.489781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed1946-81ed-420f-bbb2-b04b55f35289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.490058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed1946-81ed-420f-bbb2-b04b55f35289 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.490700 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed1946-81ed-420f-bbb2-b04b55f35289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:57.492987 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed1946-81ed-420f-bbb2-b04b55f35289 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:57.520851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1338/2668] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:57 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:57.522238 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e77a3-2452-4d9b-aeff-bae16651b8fd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:57.537722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e77a3-2452-4d9b-aeff-bae16651b8fd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:57.542399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1799127-19bb-4559-8e0d-2947df2e2f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:57.543037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799127-19bb-4559-8e0d-2947df2e2f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.543317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799127-19bb-4559-8e0d-2947df2e2f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.543596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799127-19bb-4559-8e0d-2947df2e2f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.544225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799127-19bb-4559-8e0d-2947df2e2f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:57.545870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799127-19bb-4559-8e0d-2947df2e2f89 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:57.567591 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1331/2669] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:57.567707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed1946-81ed-420f-bbb2-b04b55f35289 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:57.575964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed1946-81ed-420f-bbb2-b04b55f35289 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:57.581686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e65bc2-ff9b-4c06-9e6f-6f0bc5aa598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:57.582248 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65bc2-ff9b-4c06-9e6f-6f0bc5aa598c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.582626 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65bc2-ff9b-4c06-9e6f-6f0bc5aa598c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.582788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65bc2-ff9b-4c06-9e6f-6f0bc5aa598c admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.583420 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e65bc2-ff9b-4c06-9e6f-6f0bc5aa598c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:57.585017 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e65bc2-ff9b-4c06-9e6f-6f0bc5aa598c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:57.599278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1339/2670] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:57.600386 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1799127-19bb-4559-8e0d-2947df2e2f89 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:57.611131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1799127-19bb-4559-8e0d-2947df2e2f89 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:57.615904 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78c7b5-4c81-4159-bb6c-8589cb8bf2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:57.616547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78c7b5-4c81-4159-bb6c-8589cb8bf2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.616825 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78c7b5-4c81-4159-bb6c-8589cb8bf2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.617095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78c7b5-4c81-4159-bb6c-8589cb8bf2b6 admin admin] PATH_INFO: `/v3/projects/9c1e8197431843b89ad19f4650223692/users/3ddabe7567214286b56e216304f8225d/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.632177 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78c7b5-4c81-4159-bb6c-8589cb8bf2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1e8197431843b89ad19f4650223692, user_id=3ddabe7567214286b56e216304f8225d, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:57.634862 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78c7b5-4c81-4159-bb6c-8589cb8bf2b6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:57.647746 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1332/2671] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:57 2022] PUT /identity/v3/projects/9c1e8197431843b89ad19f4650223692/users/3ddabe7567214286b56e216304f8225d/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:57.659997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf597a-f6d2-4b88-b826-51b12c48a988 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.660374 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf597a-f6d2-4b88-b826-51b12c48a988 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.660844 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf597a-f6d2-4b88-b826-51b12c48a988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.690872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d3bf597a-f6d2-4b88-b826-51b12c48a988 None None] MFA Rules not processed for user `3ddabe7567214286b56e216304f8225d`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:57.692080 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d3bf597a-f6d2-4b88-b826-51b12c48a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:57.757282 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1340/2672] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:57.761590 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78c7b5-4c81-4159-bb6c-8589cb8bf2b6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:57.824662 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78c7b5-4c81-4159-bb6c-8589cb8bf2b6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:57.830255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcdcb6-9ac8-4886-b867-24f03e335a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:57.830859 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcdcb6-9ac8-4886-b867-24f03e335a5d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.831143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcdcb6-9ac8-4886-b867-24f03e335a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.831419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcdcb6-9ac8-4886-b867-24f03e335a5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.832108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcdcb6-9ac8-4886-b867-24f03e335a5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:57.834117 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcdcb6-9ac8-4886-b867-24f03e335a5d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:57.867212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1333/2673] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:28:57 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:28:57.868161 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf597a-f6d2-4b88-b826-51b12c48a988 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:57.878997 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf597a-f6d2-4b88-b826-51b12c48a988 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:57.892396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:57.940653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb280e6-fb6b-498d-8af4-7eedb7035c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:57.941392 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb280e6-fb6b-498d-8af4-7eedb7035c8a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.941702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb280e6-fb6b-498d-8af4-7eedb7035c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.941985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb280e6-fb6b-498d-8af4-7eedb7035c8a admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.942712 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb280e6-fb6b-498d-8af4-7eedb7035c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:57.944651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb280e6-fb6b-498d-8af4-7eedb7035c8a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:57.969745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1341/2674] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:28:57 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:28:57.971512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcdcb6-9ac8-4886-b867-24f03e335a5d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:57.983857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcdcb6-9ac8-4886-b867-24f03e335a5d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:57.988458 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a92bc-bb9e-4fea-a423-bfa2ac0a2e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:57.989086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a92bc-bb9e-4fea-a423-bfa2ac0a2e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:57.989363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a92bc-bb9e-4fea-a423-bfa2ac0a2e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:57.989640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a92bc-bb9e-4fea-a423-bfa2ac0a2e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:57.990310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a92bc-bb9e-4fea-a423-bfa2ac0a2e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:57.992007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a92bc-bb9e-4fea-a423-bfa2ac0a2e24 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:58.010020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1334/2675] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:58.011724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb280e6-fb6b-498d-8af4-7eedb7035c8a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:58.023212 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb280e6-fb6b-498d-8af4-7eedb7035c8a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:58.027943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f455f79-306e-4d15-b11a-3e3fba808f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:58.028597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f455f79-306e-4d15-b11a-3e3fba808f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:58.028877 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f455f79-306e-4d15-b11a-3e3fba808f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:58.029150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f455f79-306e-4d15-b11a-3e3fba808f5c admin admin] PATH_INFO: `/v3/projects/33e70fb552954e87a6875bbbff02b043/users/459a75d0feac4f2a91564f8d248cf4d1/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:58.044004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f455f79-306e-4d15-b11a-3e3fba808f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e70fb552954e87a6875bbbff02b043, user_id=459a75d0feac4f2a91564f8d248cf4d1, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:58.046756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f455f79-306e-4d15-b11a-3e3fba808f5c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:58.060033 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1342/2676] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:58 2022] PUT /identity/v3/projects/33e70fb552954e87a6875bbbff02b043/users/459a75d0feac4f2a91564f8d248cf4d1/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:58.064806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a92bc-bb9e-4fea-a423-bfa2ac0a2e24 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:58.075016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a92bc-bb9e-4fea-a423-bfa2ac0a2e24 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:58.090627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:58.144145 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc91bc7-de5c-42e7-b213-9285be4c94ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:58.144533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc91bc7-de5c-42e7-b213-9285be4c94ae admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:58.144810 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc91bc7-de5c-42e7-b213-9285be4c94ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:58.145080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc91bc7-de5c-42e7-b213-9285be4c94ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:58.145719 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc91bc7-de5c-42e7-b213-9285be4c94ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:58.151406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc91bc7-de5c-42e7-b213-9285be4c94ae admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:58.164618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1335/2677] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:28:58.165777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f455f79-306e-4d15-b11a-3e3fba808f5c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:58.176130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f455f79-306e-4d15-b11a-3e3fba808f5c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:58.180890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233fcb2-614a-469c-881a-e9cb963002fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:58.181556 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233fcb2-614a-469c-881a-e9cb963002fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:58.181835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233fcb2-614a-469c-881a-e9cb963002fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:58.182140 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233fcb2-614a-469c-881a-e9cb963002fa admin admin] PATH_INFO: `/v3/projects/33e70fb552954e87a6875bbbff02b043/users/459a75d0feac4f2a91564f8d248cf4d1/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:58.184189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233fcb2-614a-469c-881a-e9cb963002fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e70fb552954e87a6875bbbff02b043, user_id=459a75d0feac4f2a91564f8d248cf4d1, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:58.187398 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233fcb2-614a-469c-881a-e9cb963002fa admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:58.201497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1343/2678] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:28:58 2022] PUT /identity/v3/projects/33e70fb552954e87a6875bbbff02b043/users/459a75d0feac4f2a91564f8d248cf4d1/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:58.214173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b30d8d-5393-49da-97ba-d72f5a0948d4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:58.214718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b30d8d-5393-49da-97ba-d72f5a0948d4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:58.215176 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b30d8d-5393-49da-97ba-d72f5a0948d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:58.248065 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-02b30d8d-5393-49da-97ba-d72f5a0948d4 None None] MFA Rules not processed for user `459a75d0feac4f2a91564f8d248cf4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:58.249883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-02b30d8d-5393-49da-97ba-d72f5a0948d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:58.342576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1336/2679] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:58.354331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233fcb2-614a-469c-881a-e9cb963002fa admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:58.356062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9233fcb2-614a-469c-881a-e9cb963002fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:58.417646 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233fcb2-614a-469c-881a-e9cb963002fa admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:58.422055 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551e33c-bac2-4d4f-afcc-b735da24dd22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:58.422738 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551e33c-bac2-4d4f-afcc-b735da24dd22 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:58.423070 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551e33c-bac2-4d4f-afcc-b735da24dd22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:58.423372 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551e33c-bac2-4d4f-afcc-b735da24dd22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:58.489353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551e33c-bac2-4d4f-afcc-b735da24dd22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:58.491056 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551e33c-bac2-4d4f-afcc-b735da24dd22 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:58.502569 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1344/2680] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:28:59.353035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b30d8d-5393-49da-97ba-d72f5a0948d4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:59.354539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-02b30d8d-5393-49da-97ba-d72f5a0948d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:59.421831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b30d8d-5393-49da-97ba-d72f5a0948d4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:59.426449 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:59.427086 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:59.427370 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:59.427635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] PATH_INFO: `/v3/users/b3026bdc47b74e86aa0abce7ac709602` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:59.428752 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3026bdc47b74e86aa0abce7ac709602)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:59.430710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:59.473322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:59.482757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3026bdc47b74e86aa0abce7ac709602'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:59.483417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3026bdc47b74e86aa0abce7ac709602'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:59.484070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3026bdc47b74e86aa0abce7ac709602'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:59.494375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3026bdc47b74e86aa0abce7ac709602'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:59.502767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3026bdc47b74e86aa0abce7ac709602'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:28:59.522367 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1337/2681] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:28:59 2022] DELETE /identity/v3/users/b3026bdc47b74e86aa0abce7ac709602 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:28:59.527195 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9c3f-4519-4fce-a00a-d7df70598b96 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:59.527672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9c3f-4519-4fce-a00a-d7df70598b96 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:59.527796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f9c3f-4519-4fce-a00a-d7df70598b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:59.546819 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-616f9c3f-4519-4fce-a00a-d7df70598b96 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:28:59.548088 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-616f9c3f-4519-4fce-a00a-d7df70598b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:59.573544 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:28:59.618084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1345/2682] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:28:59.628610 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:59.630162 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:28:59.696903 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea1ec1-0ef5-4f0d-8bd8-f4f87dc5729a admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:28:59.700637 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511e833-a09b-4606-89bb-dd79f5454c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:28:59.701242 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511e833-a09b-4606-89bb-dd79f5454c2c service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:28:59.701522 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511e833-a09b-4606-89bb-dd79f5454c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:28:59.702390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511e833-a09b-4606-89bb-dd79f5454c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:28:59.713012 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511e833-a09b-4606-89bb-dd79f5454c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:28:59.714626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511e833-a09b-4606-89bb-dd79f5454c2c service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:28:59.724806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1338/2683] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:28:59.966489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f9c3f-4519-4fce-a00a-d7df70598b96 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:28:59.969821 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-616f9c3f-4519-4fce-a00a-d7df70598b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:00.118978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f9c3f-4519-4fce-a00a-d7df70598b96 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:00.126193 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83135599-2139-40d5-aeae-fc322a0e88b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:00.126391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83135599-2139-40d5-aeae-fc322a0e88b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:00.126724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83135599-2139-40d5-aeae-fc322a0e88b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:00.127108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83135599-2139-40d5-aeae-fc322a0e88b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:00.127246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511e833-a09b-4606-89bb-dd79f5454c2c service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:00.129025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5511e833-a09b-4606-89bb-dd79f5454c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:00.129532 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-83135599-2139-40d5-aeae-fc322a0e88b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:00.157235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511e833-a09b-4606-89bb-dd79f5454c2c service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:00.165815 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:00.166893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:00.167382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:00.167922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] PATH_INFO: `/v3/projects/e6841711cbfd4b83ac7decb6b3e9e794` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:00.169938 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6841711cbfd4b83ac7decb6b3e9e794)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:00.173101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:00.230882 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83135599-2139-40d5-aeae-fc322a0e88b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:00.235034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83135599-2139-40d5-aeae-fc322a0e88b0 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:00.247778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1346/2684] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:28:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:00.260351 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6841711cbfd4b83ac7decb6b3e9e794', 'request_id': 'req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:00.269425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6841711cbfd4b83ac7decb6b3e9e794', 'request_id': 'req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:00.280642 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6841711cbfd4b83ac7decb6b3e9e794', 'request_id': 'req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:00.308022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] The token cache is being invalidate because project e6841711cbfd4b83ac7decb6b3e9e794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:00.308941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:00.309847 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-9700b2c1-cfd5-4f2d-9c2d-5a99fb2f7c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:00.323335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1339/2685] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:00 2022] DELETE /identity/v3/projects/e6841711cbfd4b83ac7decb6b3e9e794 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:02.192286 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83135599-2139-40d5-aeae-fc322a0e88b0 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:02.193799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-83135599-2139-40d5-aeae-fc322a0e88b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:02.207342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83135599-2139-40d5-aeae-fc322a0e88b0 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:02.263096 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:02.263724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:02.264002 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:02.264818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] PATH_INFO: `/v3/users/9414b728c6f54c9f94cd75196018f2bb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:02.265945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9414b728c6f54c9f94cd75196018f2bb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:02.267873 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:02.284588 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:02.315846 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9414b728c6f54c9f94cd75196018f2bb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:02.322985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9414b728c6f54c9f94cd75196018f2bb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:02.335720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9414b728c6f54c9f94cd75196018f2bb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:02.343897 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9414b728c6f54c9f94cd75196018f2bb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:02.344514 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9414b728c6f54c9f94cd75196018f2bb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:02.351074 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1347/2686] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:02 2022] DELETE /identity/v3/users/9414b728c6f54c9f94cd75196018f2bb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:02.355709 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20089cf9-d7b1-493c-8380-ea102bbf11a3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:02.356180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20089cf9-d7b1-493c-8380-ea102bbf11a3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:02.356326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20089cf9-d7b1-493c-8380-ea102bbf11a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:02.374712 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-20089cf9-d7b1-493c-8380-ea102bbf11a3 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:02.375913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-20089cf9-d7b1-493c-8380-ea102bbf11a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:02.411247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:02.438081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1340/2687] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:02.448660 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:02.450186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:02.509267 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65e9d4-9556-41e2-b758-eccc576ad079 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:02.512974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47aeabd-a415-44e8-b737-919151bb6470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:02.513575 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47aeabd-a415-44e8-b737-919151bb6470 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:02.513853 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47aeabd-a415-44e8-b737-919151bb6470 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:02.514201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47aeabd-a415-44e8-b737-919151bb6470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:02.523674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47aeabd-a415-44e8-b737-919151bb6470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:02.525093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47aeabd-a415-44e8-b737-919151bb6470 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:02.534696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1348/2688] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:29:02.795792 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20089cf9-d7b1-493c-8380-ea102bbf11a3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:02.797297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-20089cf9-d7b1-493c-8380-ea102bbf11a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:02.809852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20089cf9-d7b1-493c-8380-ea102bbf11a3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:02.815143 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:02.815786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:02.816066 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:02.816404 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] PATH_INFO: `/v3/projects/8d57568c22794ee99a287ecdc2302151` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:02.817543 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d57568c22794ee99a287ecdc2302151)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:02.819485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:02.872583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d57568c22794ee99a287ecdc2302151', 'request_id': 'req-e619f01f-528e-4b5d-adee-0246ed7831dc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:02.879017 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d57568c22794ee99a287ecdc2302151', 'request_id': 'req-e619f01f-528e-4b5d-adee-0246ed7831dc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:02.888006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d57568c22794ee99a287ecdc2302151', 'request_id': 'req-e619f01f-528e-4b5d-adee-0246ed7831dc'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:02.899936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] The token cache is being invalidate because project 8d57568c22794ee99a287ecdc2302151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:02.900246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:02.900890 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-e619f01f-528e-4b5d-adee-0246ed7831dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:02.902392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1341/2689] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:02 2022] DELETE /identity/v3/projects/8d57568c22794ee99a287ecdc2302151 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:04.095841 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47aeabd-a415-44e8-b737-919151bb6470 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:04.097559 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d47aeabd-a415-44e8-b737-919151bb6470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:04.110604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47aeabd-a415-44e8-b737-919151bb6470 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:04.164661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:04.165277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:04.165554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:04.165826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] PATH_INFO: `/v3/users/3ddabe7567214286b56e216304f8225d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:04.166975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ddabe7567214286b56e216304f8225d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:04.168885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:04.208327 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:04.215167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ddabe7567214286b56e216304f8225d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:04.222967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ddabe7567214286b56e216304f8225d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:04.234813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ddabe7567214286b56e216304f8225d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:04.242503 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ddabe7567214286b56e216304f8225d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:04.243339 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ddabe7567214286b56e216304f8225d'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:04.250309 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1349/2690] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:04 2022] DELETE /identity/v3/users/3ddabe7567214286b56e216304f8225d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:04.255518 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dde75-135c-4de9-afa2-dc878115cf49 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:04.256055 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dde75-135c-4de9-afa2-dc878115cf49 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:04.256160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dde75-135c-4de9-afa2-dc878115cf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:04.279039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c16dde75-135c-4de9-afa2-dc878115cf49 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:04.280269 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c16dde75-135c-4de9-afa2-dc878115cf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:04.341377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:04.342943 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:04.354082 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1342/2691] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:04.362296 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dde75-135c-4de9-afa2-dc878115cf49 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:04.363849 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c16dde75-135c-4de9-afa2-dc878115cf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:04.407071 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd40b8b-f200-4977-9c5f-6d0201fedab8 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:04.410718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dbbb2-227f-405a-b8ad-9032e602fdaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:04.411326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dbbb2-227f-405a-b8ad-9032e602fdaa service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:04.411605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dbbb2-227f-405a-b8ad-9032e602fdaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:04.411872 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2dbbb2-227f-405a-b8ad-9032e602fdaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:04.413635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-db2dbbb2-227f-405a-b8ad-9032e602fdaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:04.425961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dbbb2-227f-405a-b8ad-9032e602fdaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:04.426526 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dde75-135c-4de9-afa2-dc878115cf49 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:04.427421 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2dbbb2-227f-405a-b8ad-9032e602fdaa service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:04.430298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818aae84-534b-4c2c-8ed0-730283427e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:04.430900 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aae84-534b-4c2c-8ed0-730283427e48 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:04.431178 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aae84-534b-4c2c-8ed0-730283427e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:04.431446 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aae84-534b-4c2c-8ed0-730283427e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:04.438069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1350/2692] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:29:04.440999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818aae84-534b-4c2c-8ed0-730283427e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:04.442531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818aae84-534b-4c2c-8ed0-730283427e48 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:04.452215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1343/2693] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:29:04.935355 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dbbb2-227f-405a-b8ad-9032e602fdaa service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:04.937304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-db2dbbb2-227f-405a-b8ad-9032e602fdaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:04.959618 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2dbbb2-227f-405a-b8ad-9032e602fdaa service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:04.965377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:04.966206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:04.966566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:04.966907 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] PATH_INFO: `/v3/projects/9c1e8197431843b89ad19f4650223692` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:04.968628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1e8197431843b89ad19f4650223692)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:04.970654 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:05.018629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1e8197431843b89ad19f4650223692', 'request_id': 'req-698e8c30-2c0f-4ffb-b922-43ae341c9034'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.024953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1e8197431843b89ad19f4650223692', 'request_id': 'req-698e8c30-2c0f-4ffb-b922-43ae341c9034'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.033558 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1e8197431843b89ad19f4650223692', 'request_id': 'req-698e8c30-2c0f-4ffb-b922-43ae341c9034'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.045063 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] The token cache is being invalidate because project 9c1e8197431843b89ad19f4650223692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:05.046039 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.046679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.048147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1351/2694] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:04 2022] DELETE /identity/v3/projects/9c1e8197431843b89ad19f4650223692 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:05.052256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818aae84-534b-4c2c-8ed0-730283427e48 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:05.062372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818aae84-534b-4c2c-8ed0-730283427e48 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:05.065936 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:05.122200 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2f29a-4fd5-4c69-b3f7-8c776e091514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:05.122841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2f29a-4fd5-4c69-b3f7-8c776e091514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:05.123116 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2f29a-4fd5-4c69-b3f7-8c776e091514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:05.123409 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2f29a-4fd5-4c69-b3f7-8c776e091514 admin admin] PATH_INFO: `/v3/users/459a75d0feac4f2a91564f8d248cf4d1` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:05.124536 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2f29a-4fd5-4c69-b3f7-8c776e091514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=459a75d0feac4f2a91564f8d248cf4d1)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:05.126502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2f29a-4fd5-4c69-b3f7-8c776e091514 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:05.173498 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f4c2f29a-4fd5-4c69-b3f7-8c776e091514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459a75d0feac4f2a91564f8d248cf4d1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.174461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f4c2f29a-4fd5-4c69-b3f7-8c776e091514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459a75d0feac4f2a91564f8d248cf4d1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.175125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f4c2f29a-4fd5-4c69-b3f7-8c776e091514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459a75d0feac4f2a91564f8d248cf4d1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.183124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f4c2f29a-4fd5-4c69-b3f7-8c776e091514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459a75d0feac4f2a91564f8d248cf4d1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.190995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f4c2f29a-4fd5-4c69-b3f7-8c776e091514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459a75d0feac4f2a91564f8d248cf4d1'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.209390 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1344/2695] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:05 2022] DELETE /identity/v3/users/459a75d0feac4f2a91564f8d248cf4d1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:05.496959 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:05.498606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:05.532285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e8c30-2c0f-4ffb-b922-43ae341c9034 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:05.584158 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:05.610916 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:05.612014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:05.612014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:05.612460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] PATH_INFO: `/v3/projects/33e70fb552954e87a6875bbbff02b043` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:05.613895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e70fb552954e87a6875bbbff02b043)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:05.616300 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:05.685509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e70fb552954e87a6875bbbff02b043', 'request_id': 'req-1a77aa14-f8b3-4089-b467-991488025cfe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.691832 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e70fb552954e87a6875bbbff02b043', 'request_id': 'req-1a77aa14-f8b3-4089-b467-991488025cfe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.699155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e70fb552954e87a6875bbbff02b043', 'request_id': 'req-1a77aa14-f8b3-4089-b467-991488025cfe'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.711329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] The token cache is being invalidate because project 33e70fb552954e87a6875bbbff02b043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:05.711849 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.712529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1a77aa14-f8b3-4089-b467-991488025cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:05.714064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1352/2696] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:05 2022] DELETE /identity/v3/projects/33e70fb552954e87a6875bbbff02b043 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:05.719331 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d07cd-752b-4fe0-b353-d10acbd08886 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:05.719801 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d07cd-752b-4fe0-b353-d10acbd08886 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:05.719926 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d07cd-752b-4fe0-b353-d10acbd08886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:05.740922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-b93d07cd-752b-4fe0-b353-d10acbd08886 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:05.742154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b93d07cd-752b-4fe0-b353-d10acbd08886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:05.805155 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1345/2697] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:05.813227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cf937-5411-439f-a188-f74e5ca4784f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:05.813533 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cf937-5411-439f-a188-f74e5ca4784f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:05.813793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cf937-5411-439f-a188-f74e5ca4784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:05.835498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d72cf937-5411-439f-a188-f74e5ca4784f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:05.836995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d72cf937-5411-439f-a188-f74e5ca4784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:05.845673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1353/2698] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:05.850350 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d07cd-752b-4fe0-b353-d10acbd08886 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:05.861216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d07cd-752b-4fe0-b353-d10acbd08886 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:05.866461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17c694-4c1f-407c-a5ad-76fa2b2ab8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:05.867264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c694-4c1f-407c-a5ad-76fa2b2ab8ac admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:05.867686 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c694-4c1f-407c-a5ad-76fa2b2ab8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:05.868022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c694-4c1f-407c-a5ad-76fa2b2ab8ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:05.868902 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17c694-4c1f-407c-a5ad-76fa2b2ab8ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:29:05.869304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17c694-4c1f-407c-a5ad-76fa2b2ab8ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:05.871140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17c694-4c1f-407c-a5ad-76fa2b2ab8ac admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:05.883841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1346/2699] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:29:05.888204 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cf937-5411-439f-a188-f74e5ca4784f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:05.897900 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cf937-5411-439f-a188-f74e5ca4784f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:05.902857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7ed4-b09b-42b1-a25d-e01041799c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:05.903643 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7ed4-b09b-42b1-a25d-e01041799c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:05.903906 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7ed4-b09b-42b1-a25d-e01041799c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:05.904263 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7ed4-b09b-42b1-a25d-e01041799c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:05.905022 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e7ed4-b09b-42b1-a25d-e01041799c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:05.907053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e7ed4-b09b-42b1-a25d-e01041799c29 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:05.943529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1354/2700] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:05 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:05.947587 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17c694-4c1f-407c-a5ad-76fa2b2ab8ac admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:05.957947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17c694-4c1f-407c-a5ad-76fa2b2ab8ac admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:05.967458 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:06.028034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820bdbf-b9e5-4b7c-bf81-b696926f3778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:06.028681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820bdbf-b9e5-4b7c-bf81-b696926f3778 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.029024 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820bdbf-b9e5-4b7c-bf81-b696926f3778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.029365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820bdbf-b9e5-4b7c-bf81-b696926f3778 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.030128 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820bdbf-b9e5-4b7c-bf81-b696926f3778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:06.032142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820bdbf-b9e5-4b7c-bf81-b696926f3778 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:06.057713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1347/2701] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:05 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:06.061659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7ed4-b09b-42b1-a25d-e01041799c29 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:06.071915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7ed4-b09b-42b1-a25d-e01041799c29 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:06.078879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c52c2c-8def-4795-85cb-3717b41b244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:06.079483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c52c2c-8def-4795-85cb-3717b41b244b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.079763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c52c2c-8def-4795-85cb-3717b41b244b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.080038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c52c2c-8def-4795-85cb-3717b41b244b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.080957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c52c2c-8def-4795-85cb-3717b41b244b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:06.082329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c52c2c-8def-4795-85cb-3717b41b244b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:06.094367 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1355/2702] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:06.098772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820bdbf-b9e5-4b7c-bf81-b696926f3778 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:06.109639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820bdbf-b9e5-4b7c-bf81-b696926f3778 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:06.114554 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66aae97-0775-4aef-a4f9-49c014c10105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:06.115255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aae97-0775-4aef-a4f9-49c014c10105 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.115598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aae97-0775-4aef-a4f9-49c014c10105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.115966 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66aae97-0775-4aef-a4f9-49c014c10105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.116671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66aae97-0775-4aef-a4f9-49c014c10105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:06.118490 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66aae97-0775-4aef-a4f9-49c014c10105 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:06.136313 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1348/2703] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:06.137810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c52c2c-8def-4795-85cb-3717b41b244b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:06.147974 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c52c2c-8def-4795-85cb-3717b41b244b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:06.152964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de3d71-14f9-4607-ab28-dac6c69912f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:06.153690 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de3d71-14f9-4607-ab28-dac6c69912f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.154051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de3d71-14f9-4607-ab28-dac6c69912f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.154446 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de3d71-14f9-4607-ab28-dac6c69912f1 admin admin] PATH_INFO: `/v3/projects/378542d481ca44b7801f93892db039ba/users/14a105a2668645cf8cd0119580171133/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.170918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de3d71-14f9-4607-ab28-dac6c69912f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378542d481ca44b7801f93892db039ba, user_id=14a105a2668645cf8cd0119580171133, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:06.173698 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de3d71-14f9-4607-ab28-dac6c69912f1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:06.191429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1356/2704] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:06 2022] PUT /identity/v3/projects/378542d481ca44b7801f93892db039ba/users/14a105a2668645cf8cd0119580171133/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:06.202458 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60a6af-3325-4e39-98c9-457fb8b06214 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.202747 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60a6af-3325-4e39-98c9-457fb8b06214 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.203026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60a6af-3325-4e39-98c9-457fb8b06214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.234319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-ef60a6af-3325-4e39-98c9-457fb8b06214 None None] MFA Rules not processed for user `14a105a2668645cf8cd0119580171133`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:06.235573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-ef60a6af-3325-4e39-98c9-457fb8b06214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:06.316624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1349/2705] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:06.317461 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de3d71-14f9-4607-ab28-dac6c69912f1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:06.387317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de3d71-14f9-4607-ab28-dac6c69912f1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:06.392977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915bcfa-bdb3-4f50-ad8c-bebe27c4cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:06.393693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915bcfa-bdb3-4f50-ad8c-bebe27c4cb1b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.394111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915bcfa-bdb3-4f50-ad8c-bebe27c4cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.394483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915bcfa-bdb3-4f50-ad8c-bebe27c4cb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.395336 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915bcfa-bdb3-4f50-ad8c-bebe27c4cb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:06.397208 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915bcfa-bdb3-4f50-ad8c-bebe27c4cb1b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:06.414885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:06.434060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1357/2706] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:06 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:06.438619 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60a6af-3325-4e39-98c9-457fb8b06214 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:06.449893 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60a6af-3325-4e39-98c9-457fb8b06214 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:06.519139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db3df7-cdce-4334-b082-c2dba615e31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:06.520172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db3df7-cdce-4334-b082-c2dba615e31d admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.520172 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db3df7-cdce-4334-b082-c2dba615e31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.520528 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db3df7-cdce-4334-b082-c2dba615e31d admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.521243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db3df7-cdce-4334-b082-c2dba615e31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:06.523303 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db3df7-cdce-4334-b082-c2dba615e31d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:06.549463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1350/2707] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:06 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:06.556128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915bcfa-bdb3-4f50-ad8c-bebe27c4cb1b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:06.567484 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915bcfa-bdb3-4f50-ad8c-bebe27c4cb1b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:06.572185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f0add-f2fc-4231-b877-42316ec0a87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:06.573672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f0add-f2fc-4231-b877-42316ec0a87f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.573940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f0add-f2fc-4231-b877-42316ec0a87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.574249 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f0add-f2fc-4231-b877-42316ec0a87f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.574901 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f0add-f2fc-4231-b877-42316ec0a87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:06.577093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f0add-f2fc-4231-b877-42316ec0a87f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:06.588467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1358/2708] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:06.592614 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db3df7-cdce-4334-b082-c2dba615e31d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:06.603454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db3df7-cdce-4334-b082-c2dba615e31d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:06.608661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c48b1c-dfa8-4532-843d-27da05a3f283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:06.609301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48b1c-dfa8-4532-843d-27da05a3f283 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.609580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48b1c-dfa8-4532-843d-27da05a3f283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.609855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c48b1c-dfa8-4532-843d-27da05a3f283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.610557 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c48b1c-dfa8-4532-843d-27da05a3f283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:06.612191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c48b1c-dfa8-4532-843d-27da05a3f283 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:06.617827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:06.623475 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1351/2709] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:29:06.627970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f0add-f2fc-4231-b877-42316ec0a87f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:06.638573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f0add-f2fc-4231-b877-42316ec0a87f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:06.643188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b63204-0b1a-44d6-80b6-796850d6e697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:06.643851 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b63204-0b1a-44d6-80b6-796850d6e697 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.644131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b63204-0b1a-44d6-80b6-796850d6e697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.644407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b63204-0b1a-44d6-80b6-796850d6e697 admin admin] PATH_INFO: `/v3/projects/e40512c7e5144764a6c49e56837362bb/users/69c03aa1f05642bc8940720165e694d4/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.660036 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b63204-0b1a-44d6-80b6-796850d6e697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40512c7e5144764a6c49e56837362bb, user_id=69c03aa1f05642bc8940720165e694d4, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:06.662721 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b63204-0b1a-44d6-80b6-796850d6e697 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:06.677710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1359/2710] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:06 2022] PUT /identity/v3/projects/e40512c7e5144764a6c49e56837362bb/users/69c03aa1f05642bc8940720165e694d4/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:06.688379 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d686c-abc8-4626-8112-77ba2ccb5d34 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.688665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d686c-abc8-4626-8112-77ba2ccb5d34 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.688942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d686c-abc8-4626-8112-77ba2ccb5d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.716567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-313d686c-abc8-4626-8112-77ba2ccb5d34 None None] MFA Rules not processed for user `69c03aa1f05642bc8940720165e694d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:06.717816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-313d686c-abc8-4626-8112-77ba2ccb5d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:06.785197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1352/2711] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:06.789737 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b63204-0b1a-44d6-80b6-796850d6e697 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:06.862616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b63204-0b1a-44d6-80b6-796850d6e697 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:06.868011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea009a9e-8eb4-40e3-b0fe-49dc4de738c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:06.868358 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea009a9e-8eb4-40e3-b0fe-49dc4de738c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.868651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea009a9e-8eb4-40e3-b0fe-49dc4de738c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.869020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea009a9e-8eb4-40e3-b0fe-49dc4de738c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.869991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea009a9e-8eb4-40e3-b0fe-49dc4de738c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:06.871985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea009a9e-8eb4-40e3-b0fe-49dc4de738c4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:06.911318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1360/2712] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:06 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:06.915468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d686c-abc8-4626-8112-77ba2ccb5d34 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:06.926891 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d686c-abc8-4626-8112-77ba2ccb5d34 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:06.991905 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c89244-c5f4-4de5-aebc-eb9a230ee060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:06.992535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c89244-c5f4-4de5-aebc-eb9a230ee060 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:06.992913 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c89244-c5f4-4de5-aebc-eb9a230ee060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:06.993198 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c89244-c5f4-4de5-aebc-eb9a230ee060 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:06.993828 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c89244-c5f4-4de5-aebc-eb9a230ee060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:06.995823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c89244-c5f4-4de5-aebc-eb9a230ee060 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:07.019180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1353/2713] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:06 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:07.023079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea009a9e-8eb4-40e3-b0fe-49dc4de738c4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:07.033336 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea009a9e-8eb4-40e3-b0fe-49dc4de738c4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:07.038290 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153f909-82ab-4c57-9725-234ecb1b04fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:07.039027 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153f909-82ab-4c57-9725-234ecb1b04fe admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:07.039386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153f909-82ab-4c57-9725-234ecb1b04fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:07.039739 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153f909-82ab-4c57-9725-234ecb1b04fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:07.040586 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153f909-82ab-4c57-9725-234ecb1b04fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:07.042386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153f909-82ab-4c57-9725-234ecb1b04fe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:07.053341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1361/2714] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:07.057621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c89244-c5f4-4de5-aebc-eb9a230ee060 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:07.068454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c89244-c5f4-4de5-aebc-eb9a230ee060 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:07.073140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a7b8a-3bd0-46c7-80c3-8646217281a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:07.073884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a7b8a-3bd0-46c7-80c3-8646217281a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:07.074216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a7b8a-3bd0-46c7-80c3-8646217281a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:07.074458 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a7b8a-3bd0-46c7-80c3-8646217281a6 admin admin] PATH_INFO: `/v3/projects/0739a824af9a46c3943a2e91a66f30a9/users/55aedc21f6564641af562f236bbbefea/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:07.095093 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a7b8a-3bd0-46c7-80c3-8646217281a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0739a824af9a46c3943a2e91a66f30a9, user_id=55aedc21f6564641af562f236bbbefea, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:07.098100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a7b8a-3bd0-46c7-80c3-8646217281a6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:07.114794 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1354/2715] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:07 2022] PUT /identity/v3/projects/0739a824af9a46c3943a2e91a66f30a9/users/55aedc21f6564641af562f236bbbefea/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:29:07.119179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153f909-82ab-4c57-9725-234ecb1b04fe admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:07.130330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153f909-82ab-4c57-9725-234ecb1b04fe admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:07.197579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73200f-f20f-482b-9768-43304f8b9290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:07.198409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73200f-f20f-482b-9768-43304f8b9290 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:07.198786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73200f-f20f-482b-9768-43304f8b9290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:07.199189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73200f-f20f-482b-9768-43304f8b9290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:07.199948 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73200f-f20f-482b-9768-43304f8b9290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:07.202587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73200f-f20f-482b-9768-43304f8b9290 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:07.213998 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1362/2716] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:29:07.218437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a7b8a-3bd0-46c7-80c3-8646217281a6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:07.234136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a7b8a-3bd0-46c7-80c3-8646217281a6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:07.238907 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f6c13-67d7-47af-bab5-0332aba354aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:07.239589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6c13-67d7-47af-bab5-0332aba354aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:07.239876 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6c13-67d7-47af-bab5-0332aba354aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:07.240148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6c13-67d7-47af-bab5-0332aba354aa admin admin] PATH_INFO: `/v3/projects/0739a824af9a46c3943a2e91a66f30a9/users/55aedc21f6564641af562f236bbbefea/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:07.242173 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f6c13-67d7-47af-bab5-0332aba354aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0739a824af9a46c3943a2e91a66f30a9, user_id=55aedc21f6564641af562f236bbbefea, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:07.244841 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f6c13-67d7-47af-bab5-0332aba354aa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:07.256658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1355/2717] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:07 2022] PUT /identity/v3/projects/0739a824af9a46c3943a2e91a66f30a9/users/55aedc21f6564641af562f236bbbefea/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:07.268886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ab4f-55c0-4082-b811-e54b606309de None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:07.269442 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ab4f-55c0-4082-b811-e54b606309de None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:07.269893 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38ab4f-55c0-4082-b811-e54b606309de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:07.312067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-5e38ab4f-55c0-4082-b811-e54b606309de None None] MFA Rules not processed for user `55aedc21f6564641af562f236bbbefea`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:07.313679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5e38ab4f-55c0-4082-b811-e54b606309de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:07.338565 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:07.399471 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1363/2718] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:07.410596 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f6c13-67d7-47af-bab5-0332aba354aa admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:07.415240 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-6d9f6c13-67d7-47af-bab5-0332aba354aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:07.477816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:07.493626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f6c13-67d7-47af-bab5-0332aba354aa admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:07.497718 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb684a-fdb0-42b6-9824-ce149ae87c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:07.498324 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb684a-fdb0-42b6-9824-ce149ae87c2b service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:07.499255 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb684a-fdb0-42b6-9824-ce149ae87c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:07.499618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb684a-fdb0-42b6-9824-ce149ae87c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:07.509520 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb684a-fdb0-42b6-9824-ce149ae87c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:07.511160 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb684a-fdb0-42b6-9824-ce149ae87c2b service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:07.522777 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1356/2719] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:07.963061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38ab4f-55c0-4082-b811-e54b606309de None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:07.965258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-5e38ab4f-55c0-4082-b811-e54b606309de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:08.049030 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38ab4f-55c0-4082-b811-e54b606309de None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:08.055108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:08.055839 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.056201 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.056554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] PATH_INFO: `/v3/users/957c3a73b4f14927905fde65c9c844cb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:08.057763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=957c3a73b4f14927905fde65c9c844cb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:08.060067 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:08.119444 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957c3a73b4f14927905fde65c9c844cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:08.127084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957c3a73b4f14927905fde65c9c844cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:08.139774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb684a-fdb0-42b6-9824-ce149ae87c2b service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:08.140326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957c3a73b4f14927905fde65c9c844cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:08.141603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-95bb684a-fdb0-42b6-9824-ce149ae87c2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:08.147982 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957c3a73b4f14927905fde65c9c844cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:08.148818 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957c3a73b4f14927905fde65c9c844cb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:08.154916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb684a-fdb0-42b6-9824-ce149ae87c2b service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:08.156442 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1364/2720] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:07 2022] DELETE /identity/v3/users/957c3a73b4f14927905fde65c9c844cb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:08.213063 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4e70a-641d-44d4-af05-a37c3b530dd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:08.213672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4e70a-641d-44d4-af05-a37c3b530dd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.213948 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4e70a-641d-44d4-af05-a37c3b530dd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.214245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4e70a-641d-44d4-af05-a37c3b530dd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:08.216101 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-77b4e70a-641d-44d4-af05-a37c3b530dd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:08.277604 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4e70a-641d-44d4-af05-a37c3b530dd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:08.279081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4e70a-641d-44d4-af05-a37c3b530dd1 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:08.288375 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1357/2721] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:29:08.335729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:08.337239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:08.378046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:08.410390 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18edd0-082c-45fe-bc22-66e9cf0ce279 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:08.415198 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:08.415842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.416167 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.416447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] PATH_INFO: `/v3/projects/0969a034b7804c69ad11629bc9c42268` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:08.417704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0969a034b7804c69ad11629bc9c42268)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:08.419777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:08.470010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0969a034b7804c69ad11629bc9c42268', 'request_id': 'req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:08.477035 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0969a034b7804c69ad11629bc9c42268', 'request_id': 'req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:08.485104 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0969a034b7804c69ad11629bc9c42268', 'request_id': 'req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:08.496733 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] The token cache is being invalidate because project 0969a034b7804c69ad11629bc9c42268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:08.497045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:08.497679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-1e5cbfe9-bc98-4c73-854c-0066d8ea67bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:08.499258 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1365/2722] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:08 2022] DELETE /identity/v3/projects/0969a034b7804c69ad11629bc9c42268 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:29:08.504646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aa8dd-6135-482f-aa98-1b3243c14d8c None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.505018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aa8dd-6135-482f-aa98-1b3243c14d8c None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.505355 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417aa8dd-6135-482f-aa98-1b3243c14d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:08.530896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-417aa8dd-6135-482f-aa98-1b3243c14d8c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:08.532153 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-417aa8dd-6135-482f-aa98-1b3243c14d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:08.617915 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1358/2723] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:08.626809 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd85a-83db-4a4f-ac69-d0b245969b1d None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.627111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd85a-83db-4a4f-ac69-d0b245969b1d None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.627369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd85a-83db-4a4f-ac69-d0b245969b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:08.650178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-58efd85a-83db-4a4f-ac69-d0b245969b1d None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:08.651429 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-58efd85a-83db-4a4f-ac69-d0b245969b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:08.660332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1366/2724] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:08.664699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417aa8dd-6135-482f-aa98-1b3243c14d8c None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:08.676487 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417aa8dd-6135-482f-aa98-1b3243c14d8c None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:08.681598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a812b-c138-4bf9-9cd0-8da08fdd299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:08.682219 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a812b-c138-4bf9-9cd0-8da08fdd299f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.682494 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a812b-c138-4bf9-9cd0-8da08fdd299f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.682762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a812b-c138-4bf9-9cd0-8da08fdd299f admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:08.683397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a812b-c138-4bf9-9cd0-8da08fdd299f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:29:08.683697 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a812b-c138-4bf9-9cd0-8da08fdd299f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:08.685338 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a812b-c138-4bf9-9cd0-8da08fdd299f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:08.696796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1359/2725] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:29:08.701252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd85a-83db-4a4f-ac69-d0b245969b1d None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:08.710673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd85a-83db-4a4f-ac69-d0b245969b1d None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:08.715259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00688a6-caf3-4d2a-89f5-cf09f41c0770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:08.715850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00688a6-caf3-4d2a-89f5-cf09f41c0770 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.716130 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00688a6-caf3-4d2a-89f5-cf09f41c0770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.716400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00688a6-caf3-4d2a-89f5-cf09f41c0770 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:08.717020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00688a6-caf3-4d2a-89f5-cf09f41c0770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:08.719447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00688a6-caf3-4d2a-89f5-cf09f41c0770 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:08.749481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1367/2726] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:08 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:08.750865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a812b-c138-4bf9-9cd0-8da08fdd299f admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:08.760802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a812b-c138-4bf9-9cd0-8da08fdd299f admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:08.785318 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:08.817688 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e96be-1fef-4462-9b48-79004a288ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:08.818315 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e96be-1fef-4462-9b48-79004a288ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.818600 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e96be-1fef-4462-9b48-79004a288ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.818878 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e96be-1fef-4462-9b48-79004a288ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:08.819504 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e96be-1fef-4462-9b48-79004a288ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:08.821429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e96be-1fef-4462-9b48-79004a288ad3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:08.844363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1360/2727] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:08 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:08.848752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00688a6-caf3-4d2a-89f5-cf09f41c0770 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:08.859026 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00688a6-caf3-4d2a-89f5-cf09f41c0770 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:08.863632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c8e4b-dc61-4e76-ae8d-75ee6d815c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:08.864253 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c8e4b-dc61-4e76-ae8d-75ee6d815c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.864530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c8e4b-dc61-4e76-ae8d-75ee6d815c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.864800 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c8e4b-dc61-4e76-ae8d-75ee6d815c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:08.865437 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c8e4b-dc61-4e76-ae8d-75ee6d815c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:08.867050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c8e4b-dc61-4e76-ae8d-75ee6d815c0b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:08.877083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1368/2728] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:08.881251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e96be-1fef-4462-9b48-79004a288ad3 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:08.892260 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e96be-1fef-4462-9b48-79004a288ad3 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:08.897816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac574cf-0b7c-4910-9c75-6478559204c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:08.898567 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac574cf-0b7c-4910-9c75-6478559204c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.898969 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac574cf-0b7c-4910-9c75-6478559204c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.899364 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac574cf-0b7c-4910-9c75-6478559204c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:08.900205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac574cf-0b7c-4910-9c75-6478559204c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:08.902247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac574cf-0b7c-4910-9c75-6478559204c0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:08.914751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1361/2729] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:08.919083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c8e4b-dc61-4e76-ae8d-75ee6d815c0b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:08.928986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c8e4b-dc61-4e76-ae8d-75ee6d815c0b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:08.933656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc65f3-ef7b-4ec0-bc6c-0df46d713822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:08.934337 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc65f3-ef7b-4ec0-bc6c-0df46d713822 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.934617 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc65f3-ef7b-4ec0-bc6c-0df46d713822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.934892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc65f3-ef7b-4ec0-bc6c-0df46d713822 admin admin] PATH_INFO: `/v3/projects/94e08b137a614757ad763d5193e13a49/users/ab1a894dfdea4475866a354f90e760d6/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:08.948940 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc65f3-ef7b-4ec0-bc6c-0df46d713822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e08b137a614757ad763d5193e13a49, user_id=ab1a894dfdea4475866a354f90e760d6, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:08.952128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc65f3-ef7b-4ec0-bc6c-0df46d713822 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:08.965333 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1369/2730] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:08 2022] PUT /identity/v3/projects/94e08b137a614757ad763d5193e13a49/users/ab1a894dfdea4475866a354f90e760d6/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:29:08.976597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961d34f-4a57-48f4-9da2-c5d4c5f2cbc2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:08.976883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961d34f-4a57-48f4-9da2-c5d4c5f2cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:08.977231 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961d34f-4a57-48f4-9da2-c5d4c5f2cbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:09.006447 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5961d34f-4a57-48f4-9da2-c5d4c5f2cbc2 None None] MFA Rules not processed for user `ab1a894dfdea4475866a354f90e760d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:09.007739 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5961d34f-4a57-48f4-9da2-c5d4c5f2cbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:09.073359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1362/2731] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:09.078498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc65f3-ef7b-4ec0-bc6c-0df46d713822 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:09.138794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc65f3-ef7b-4ec0-bc6c-0df46d713822 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:09.143931 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3164134-c016-43d1-989d-651f4eda8d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:09.145274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164134-c016-43d1-989d-651f4eda8d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:09.145274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164134-c016-43d1-989d-651f4eda8d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:09.145274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164134-c016-43d1-989d-651f4eda8d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:09.145678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3164134-c016-43d1-989d-651f4eda8d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:09.147600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3164134-c016-43d1-989d-651f4eda8d2f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:09.151963 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:09.175655 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1370/2732] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:09 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:09.179787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961d34f-4a57-48f4-9da2-c5d4c5f2cbc2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:09.190774 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961d34f-4a57-48f4-9da2-c5d4c5f2cbc2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:09.247212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c55e2b-d0d1-4df8-a470-eaf31d9a23d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:09.247736 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55e2b-d0d1-4df8-a470-eaf31d9a23d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:09.248011 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55e2b-d0d1-4df8-a470-eaf31d9a23d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:09.248279 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c55e2b-d0d1-4df8-a470-eaf31d9a23d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:09.249399 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c55e2b-d0d1-4df8-a470-eaf31d9a23d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:09.251366 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c55e2b-d0d1-4df8-a470-eaf31d9a23d6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:09.272298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1363/2733] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:09 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:09.276318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3164134-c016-43d1-989d-651f4eda8d2f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:09.286670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3164134-c016-43d1-989d-651f4eda8d2f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:09.291259 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49286-c354-4efb-9b94-156f3ca8246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:09.291854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49286-c354-4efb-9b94-156f3ca8246d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:09.292138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49286-c354-4efb-9b94-156f3ca8246d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:09.292413 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49286-c354-4efb-9b94-156f3ca8246d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:09.293079 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b49286-c354-4efb-9b94-156f3ca8246d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:09.294696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b49286-c354-4efb-9b94-156f3ca8246d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:09.304414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1371/2734] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:29:09.308429 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c55e2b-d0d1-4df8-a470-eaf31d9a23d6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:09.319129 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c55e2b-d0d1-4df8-a470-eaf31d9a23d6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:09.323823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6e48c-ee78-4a99-8b79-44641d0d9376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:09.324466 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6e48c-ee78-4a99-8b79-44641d0d9376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:09.324745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6e48c-ee78-4a99-8b79-44641d0d9376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:09.325016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6e48c-ee78-4a99-8b79-44641d0d9376 admin admin] PATH_INFO: `/v3/projects/5f8006d2e8e24707b6fb7a2f02fc7d45/users/8e6e59be06a34b7e93d7e6472347fb19/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:09.339959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6e48c-ee78-4a99-8b79-44641d0d9376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8006d2e8e24707b6fb7a2f02fc7d45, user_id=8e6e59be06a34b7e93d7e6472347fb19, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:09.343188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6e48c-ee78-4a99-8b79-44641d0d9376 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:09.351911 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:09.356657 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1364/2735] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:09 2022] PUT /identity/v3/projects/5f8006d2e8e24707b6fb7a2f02fc7d45/users/8e6e59be06a34b7e93d7e6472347fb19/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:29:09.361513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49286-c354-4efb-9b94-156f3ca8246d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:09.371277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49286-c354-4efb-9b94-156f3ca8246d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:09.426929 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893ce7a-7224-4a2b-824b-be4efa36e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:09.427540 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893ce7a-7224-4a2b-824b-be4efa36e64f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:09.427824 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893ce7a-7224-4a2b-824b-be4efa36e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:09.428103 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893ce7a-7224-4a2b-824b-be4efa36e64f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:09.428748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893ce7a-7224-4a2b-824b-be4efa36e64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:09.430379 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893ce7a-7224-4a2b-824b-be4efa36e64f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:09.440091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1372/2736] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:09.444419 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6e48c-ee78-4a99-8b79-44641d0d9376 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:09.454451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6e48c-ee78-4a99-8b79-44641d0d9376 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:09.458975 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff20ee-15c6-42ac-bc2a-e30af396bf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:09.459606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff20ee-15c6-42ac-bc2a-e30af396bf23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:09.459879 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff20ee-15c6-42ac-bc2a-e30af396bf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:09.460146 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff20ee-15c6-42ac-bc2a-e30af396bf23 admin admin] PATH_INFO: `/v3/projects/5f8006d2e8e24707b6fb7a2f02fc7d45/users/8e6e59be06a34b7e93d7e6472347fb19/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:09.462022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff20ee-15c6-42ac-bc2a-e30af396bf23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8006d2e8e24707b6fb7a2f02fc7d45, user_id=8e6e59be06a34b7e93d7e6472347fb19, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:09.464640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff20ee-15c6-42ac-bc2a-e30af396bf23 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:09.475655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1365/2737] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:09 2022] PUT /identity/v3/projects/5f8006d2e8e24707b6fb7a2f02fc7d45/users/8e6e59be06a34b7e93d7e6472347fb19/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:09.486368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5e3f1-037d-4e9a-be8f-3457d329fc4f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:09.486667 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5e3f1-037d-4e9a-be8f-3457d329fc4f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:09.486947 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5e3f1-037d-4e9a-be8f-3457d329fc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:09.514561 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-04a5e3f1-037d-4e9a-be8f-3457d329fc4f None None] MFA Rules not processed for user `8e6e59be06a34b7e93d7e6472347fb19`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:09.515770 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-04a5e3f1-037d-4e9a-be8f-3457d329fc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:09.583952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1373/2738] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:09.597201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff20ee-15c6-42ac-bc2a-e30af396bf23 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:09.599284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-60ff20ee-15c6-42ac-bc2a-e30af396bf23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:09.662310 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff20ee-15c6-42ac-bc2a-e30af396bf23 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:09.665909 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a2b5f-2063-4670-975f-507515f64aa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:09.666542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a2b5f-2063-4670-975f-507515f64aa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:09.666816 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a2b5f-2063-4670-975f-507515f64aa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:09.667081 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a2b5f-2063-4670-975f-507515f64aa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:09.676788 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a2b5f-2063-4670-975f-507515f64aa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:09.678225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a2b5f-2063-4670-975f-507515f64aa1 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:09.688397 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1366/2739] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:10.120628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5e3f1-037d-4e9a-be8f-3457d329fc4f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:10.176389 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:10.181625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5e3f1-037d-4e9a-be8f-3457d329fc4f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:10.187536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:10.188196 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:10.188674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:10.188951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] PATH_INFO: `/v3/users/ab1a894dfdea4475866a354f90e760d6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:10.190120 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1a894dfdea4475866a354f90e760d6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:10.192034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:10.238205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1a894dfdea4475866a354f90e760d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.244842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1a894dfdea4475866a354f90e760d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.256780 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1a894dfdea4475866a354f90e760d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.264006 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1a894dfdea4475866a354f90e760d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.265334 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1a894dfdea4475866a354f90e760d6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.271150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1374/2740] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:10 2022] DELETE /identity/v3/users/ab1a894dfdea4475866a354f90e760d6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:10.275626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab296-27d1-47c0-a31c-cad43529ff0d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:10.276136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab296-27d1-47c0-a31c-cad43529ff0d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:10.276235 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abab296-27d1-47c0-a31c-cad43529ff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:10.295473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-7abab296-27d1-47c0-a31c-cad43529ff0d None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:10.296616 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7abab296-27d1-47c0-a31c-cad43529ff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:10.357207 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1367/2741] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:10.367364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:10.368786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:10.430689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f088a-71f3-409b-bcfc-8b3bb64f37a4 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:10.434484 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b0762-3134-44fe-9234-ae9ea50a51d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:10.435126 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0762-3134-44fe-9234-ae9ea50a51d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:10.435405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0762-3134-44fe-9234-ae9ea50a51d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:10.435677 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0762-3134-44fe-9234-ae9ea50a51d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:10.445354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b0762-3134-44fe-9234-ae9ea50a51d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:10.446835 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b0762-3134-44fe-9234-ae9ea50a51d1 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:10.456635 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1375/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:10.721486 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abab296-27d1-47c0-a31c-cad43529ff0d None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:10.723035 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7abab296-27d1-47c0-a31c-cad43529ff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:10.735959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abab296-27d1-47c0-a31c-cad43529ff0d None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:10.746560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:10.747354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:10.747735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:10.748109 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] PATH_INFO: `/v3/projects/94e08b137a614757ad763d5193e13a49` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:10.749388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e08b137a614757ad763d5193e13a49)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:10.751561 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:10.801463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e08b137a614757ad763d5193e13a49', 'request_id': 'req-7ae7351d-486b-4227-b959-b26169b9a7f6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.806888 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e08b137a614757ad763d5193e13a49', 'request_id': 'req-7ae7351d-486b-4227-b959-b26169b9a7f6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.814094 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e08b137a614757ad763d5193e13a49', 'request_id': 'req-7ae7351d-486b-4227-b959-b26169b9a7f6'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.825054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] The token cache is being invalidate because project 94e08b137a614757ad763d5193e13a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:10.825346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.825963 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.827519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1368/2743] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:10 2022] DELETE /identity/v3/projects/94e08b137a614757ad763d5193e13a49 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:10.831577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b0762-3134-44fe-9234-ae9ea50a51d1 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:10.844062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b0762-3134-44fe-9234-ae9ea50a51d1 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:10.905745 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a902e-0f2f-4de0-8ed9-d76b3dab9023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:10.906411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a902e-0f2f-4de0-8ed9-d76b3dab9023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:10.906696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a902e-0f2f-4de0-8ed9-d76b3dab9023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:10.906972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a902e-0f2f-4de0-8ed9-d76b3dab9023 admin admin] PATH_INFO: `/v3/users/8e6e59be06a34b7e93d7e6472347fb19` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:10.908099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a902e-0f2f-4de0-8ed9-d76b3dab9023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6e59be06a34b7e93d7e6472347fb19)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:10.910014 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a902e-0f2f-4de0-8ed9-d76b3dab9023 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:10.932546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:10.958418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-af3a902e-0f2f-4de0-8ed9-d76b3dab9023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6e59be06a34b7e93d7e6472347fb19'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.965287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-af3a902e-0f2f-4de0-8ed9-d76b3dab9023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6e59be06a34b7e93d7e6472347fb19'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.978702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-af3a902e-0f2f-4de0-8ed9-d76b3dab9023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6e59be06a34b7e93d7e6472347fb19'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.987268 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-af3a902e-0f2f-4de0-8ed9-d76b3dab9023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6e59be06a34b7e93d7e6472347fb19'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.987919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-af3a902e-0f2f-4de0-8ed9-d76b3dab9023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6e59be06a34b7e93d7e6472347fb19'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:10.994341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1376/2744] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:10 2022] DELETE /identity/v3/users/8e6e59be06a34b7e93d7e6472347fb19 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:11.278897 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:11.281782 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:11.296884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7351d-486b-4227-b959-b26169b9a7f6 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:11.306606 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:11.355187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:11.355812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:11.356089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:11.356359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] PATH_INFO: `/v3/projects/5f8006d2e8e24707b6fb7a2f02fc7d45` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:11.357451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8006d2e8e24707b6fb7a2f02fc7d45)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:11.359433 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:11.403872 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8006d2e8e24707b6fb7a2f02fc7d45', 'request_id': 'req-1f82928c-816f-4607-a99a-e6a48eff0225'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:11.409940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8006d2e8e24707b6fb7a2f02fc7d45', 'request_id': 'req-1f82928c-816f-4607-a99a-e6a48eff0225'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:11.416883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8006d2e8e24707b6fb7a2f02fc7d45', 'request_id': 'req-1f82928c-816f-4607-a99a-e6a48eff0225'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:11.427650 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] The token cache is being invalidate because project 5f8006d2e8e24707b6fb7a2f02fc7d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:11.427937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:11.428556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-1f82928c-816f-4607-a99a-e6a48eff0225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:11.430054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1369/2745] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:11 2022] DELETE /identity/v3/projects/5f8006d2e8e24707b6fb7a2f02fc7d45 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:11.434854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e33b6-4e53-411a-9b46-87d03135193c None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:11.435324 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e33b6-4e53-411a-9b46-87d03135193c None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:11.435419 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e33b6-4e53-411a-9b46-87d03135193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:11.455135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-985e33b6-4e53-411a-9b46-87d03135193c None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:11.456341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-985e33b6-4e53-411a-9b46-87d03135193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:11.513838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1377/2746] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:11.523353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffee50b-4400-4293-adcf-ec193356e516 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:11.523645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffee50b-4400-4293-adcf-ec193356e516 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:11.523925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffee50b-4400-4293-adcf-ec193356e516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:11.544108 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cffee50b-4400-4293-adcf-ec193356e516 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:11.545935 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cffee50b-4400-4293-adcf-ec193356e516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:11.554756 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1370/2747] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:11.559143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e33b6-4e53-411a-9b46-87d03135193c None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:11.569580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e33b6-4e53-411a-9b46-87d03135193c None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:11.574412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47489b8e-f92b-4493-ae59-0691224887ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:11.575019 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47489b8e-f92b-4493-ae59-0691224887ae admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:11.575303 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47489b8e-f92b-4493-ae59-0691224887ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:11.575580 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47489b8e-f92b-4493-ae59-0691224887ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:11.576230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47489b8e-f92b-4493-ae59-0691224887ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:29:11.577091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47489b8e-f92b-4493-ae59-0691224887ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:11.578813 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47489b8e-f92b-4493-ae59-0691224887ae admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:11.590923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1378/2748] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:29:11.595417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffee50b-4400-4293-adcf-ec193356e516 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:11.605181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffee50b-4400-4293-adcf-ec193356e516 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:11.610000 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081fc15-f8f1-4e98-b5f4-9d8ce3dca1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:11.610625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081fc15-f8f1-4e98-b5f4-9d8ce3dca1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:11.610922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081fc15-f8f1-4e98-b5f4-9d8ce3dca1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:11.611182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081fc15-f8f1-4e98-b5f4-9d8ce3dca1e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:11.611801 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081fc15-f8f1-4e98-b5f4-9d8ce3dca1e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:11.613690 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081fc15-f8f1-4e98-b5f4-9d8ce3dca1e7 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:11.641286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1371/2749] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:11 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:11.645230 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47489b8e-f92b-4493-ae59-0691224887ae admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:11.655177 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47489b8e-f92b-4493-ae59-0691224887ae admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:11.711687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e2423-d084-408b-aa2b-e7973133cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:11.712287 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e2423-d084-408b-aa2b-e7973133cb2a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:11.712563 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e2423-d084-408b-aa2b-e7973133cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:11.712831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e2423-d084-408b-aa2b-e7973133cb2a admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:11.713449 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e2423-d084-408b-aa2b-e7973133cb2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:11.715364 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e2423-d084-408b-aa2b-e7973133cb2a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:11.735386 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1379/2750] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:11 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:11.739461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081fc15-f8f1-4e98-b5f4-9d8ce3dca1e7 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:11.750006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081fc15-f8f1-4e98-b5f4-9d8ce3dca1e7 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:11.754512 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1d941-601a-4261-9e0e-cc4ac020a427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:11.755098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1d941-601a-4261-9e0e-cc4ac020a427 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:11.755376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1d941-601a-4261-9e0e-cc4ac020a427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:11.755646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1d941-601a-4261-9e0e-cc4ac020a427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:11.756277 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1d941-601a-4261-9e0e-cc4ac020a427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:11.757852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1d941-601a-4261-9e0e-cc4ac020a427 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:11.768392 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1372/2751] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:11.772131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e2423-d084-408b-aa2b-e7973133cb2a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:11.782015 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e2423-d084-408b-aa2b-e7973133cb2a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:11.787053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf972bbe-5df5-488e-b49a-eeb7ebe79d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:11.787729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972bbe-5df5-488e-b49a-eeb7ebe79d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:11.787932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972bbe-5df5-488e-b49a-eeb7ebe79d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:11.788209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972bbe-5df5-488e-b49a-eeb7ebe79d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:11.788888 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf972bbe-5df5-488e-b49a-eeb7ebe79d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:11.790520 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf972bbe-5df5-488e-b49a-eeb7ebe79d03 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:11.800896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1380/2752] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:11.805230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1d941-601a-4261-9e0e-cc4ac020a427 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:11.815802 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1d941-601a-4261-9e0e-cc4ac020a427 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:11.820408 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd17f53-7831-49db-91f6-76645d3e1696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:11.821051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd17f53-7831-49db-91f6-76645d3e1696 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:11.821332 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd17f53-7831-49db-91f6-76645d3e1696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:11.821608 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd17f53-7831-49db-91f6-76645d3e1696 admin admin] PATH_INFO: `/v3/projects/891741d47147433a9330747a0120212a/users/961cda15d3074bae8962f649fb7d3db3/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:11.837477 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd17f53-7831-49db-91f6-76645d3e1696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891741d47147433a9330747a0120212a, user_id=961cda15d3074bae8962f649fb7d3db3, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:11.840354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd17f53-7831-49db-91f6-76645d3e1696 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:11.853593 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1373/2753] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:11 2022] PUT /identity/v3/projects/891741d47147433a9330747a0120212a/users/961cda15d3074bae8962f649fb7d3db3/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:11.864394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54985f-559d-42ec-9dea-8ec32880dce1 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:11.864688 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54985f-559d-42ec-9dea-8ec32880dce1 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:11.864967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54985f-559d-42ec-9dea-8ec32880dce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:11.872062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:11.895502 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8c54985f-559d-42ec-9dea-8ec32880dce1 None None] MFA Rules not processed for user `961cda15d3074bae8962f649fb7d3db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:11.897513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8c54985f-559d-42ec-9dea-8ec32880dce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:11.968051 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1381/2754] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:11.972743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd17f53-7831-49db-91f6-76645d3e1696 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:12.014721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:12.035850 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd17f53-7831-49db-91f6-76645d3e1696 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:12.040572 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1672f5c-0128-4c64-91a3-fb16d598642e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:12.041174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1672f5c-0128-4c64-91a3-fb16d598642e admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:12.041455 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1672f5c-0128-4c64-91a3-fb16d598642e admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:12.041729 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1672f5c-0128-4c64-91a3-fb16d598642e admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:12.042394 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1672f5c-0128-4c64-91a3-fb16d598642e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:12.044291 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1672f5c-0128-4c64-91a3-fb16d598642e admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:12.069842 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1374/2755] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:11 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:12.073890 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54985f-559d-42ec-9dea-8ec32880dce1 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:12.085515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54985f-559d-42ec-9dea-8ec32880dce1 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:12.141917 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daea144-1b60-49ae-af0a-bf2ab0029f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:12.142626 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea144-1b60-49ae-af0a-bf2ab0029f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:12.142854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea144-1b60-49ae-af0a-bf2ab0029f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:12.143132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daea144-1b60-49ae-af0a-bf2ab0029f3e admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:12.143757 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daea144-1b60-49ae-af0a-bf2ab0029f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:12.145672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daea144-1b60-49ae-af0a-bf2ab0029f3e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:12.172497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1382/2756] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:12 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:29:12.189241 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1672f5c-0128-4c64-91a3-fb16d598642e admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:12.189241 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1672f5c-0128-4c64-91a3-fb16d598642e admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:12.192107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494fc97-cc25-41ec-a46a-114dfb3b4f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:12.192722 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494fc97-cc25-41ec-a46a-114dfb3b4f75 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:12.193007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494fc97-cc25-41ec-a46a-114dfb3b4f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:12.193306 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494fc97-cc25-41ec-a46a-114dfb3b4f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:12.193952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494fc97-cc25-41ec-a46a-114dfb3b4f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:12.195573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494fc97-cc25-41ec-a46a-114dfb3b4f75 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:12.210070 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1375/2757] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:12.212010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daea144-1b60-49ae-af0a-bf2ab0029f3e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:12.222756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daea144-1b60-49ae-af0a-bf2ab0029f3e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:12.227573 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e625b0-b57a-4ffc-a065-a0617845bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:12.228255 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e625b0-b57a-4ffc-a065-a0617845bb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:12.228539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e625b0-b57a-4ffc-a065-a0617845bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:12.228874 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e625b0-b57a-4ffc-a065-a0617845bb5e admin admin] PATH_INFO: `/v3/projects/cb810ab9c824460bb21c9ba60e787529/users/bcac38a6452048bbbef6b778f3aa5c2f/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:12.244371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e625b0-b57a-4ffc-a065-a0617845bb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb810ab9c824460bb21c9ba60e787529, user_id=bcac38a6452048bbbef6b778f3aa5c2f, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:12.247094 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e625b0-b57a-4ffc-a065-a0617845bb5e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:12.261145 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1383/2758] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:12 2022] PUT /identity/v3/projects/cb810ab9c824460bb21c9ba60e787529/users/bcac38a6452048bbbef6b778f3aa5c2f/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:12.265986 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494fc97-cc25-41ec-a46a-114dfb3b4f75 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:12.275950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494fc97-cc25-41ec-a46a-114dfb3b4f75 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:12.333725 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23727b3-1d1c-4140-9392-39b2b4bc3166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:12.334519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23727b3-1d1c-4140-9392-39b2b4bc3166 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:12.334689 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23727b3-1d1c-4140-9392-39b2b4bc3166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:12.335020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23727b3-1d1c-4140-9392-39b2b4bc3166 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:12.335695 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23727b3-1d1c-4140-9392-39b2b4bc3166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:12.337492 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23727b3-1d1c-4140-9392-39b2b4bc3166 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:12.348511 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1376/2759] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:12.352491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e625b0-b57a-4ffc-a065-a0617845bb5e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:12.356297 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23727b3-1d1c-4140-9392-39b2b4bc3166 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:12.357994 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c23727b3-1d1c-4140-9392-39b2b4bc3166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:12.362937 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e625b0-b57a-4ffc-a065-a0617845bb5e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:12.367714 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0887bc9-fd58-40b3-8dc9-51ebfa960c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:12.368369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0887bc9-fd58-40b3-8dc9-51ebfa960c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:12.368653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0887bc9-fd58-40b3-8dc9-51ebfa960c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:12.368957 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0887bc9-fd58-40b3-8dc9-51ebfa960c6c admin admin] PATH_INFO: `/v3/projects/cb810ab9c824460bb21c9ba60e787529/users/bcac38a6452048bbbef6b778f3aa5c2f/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:12.370960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0887bc9-fd58-40b3-8dc9-51ebfa960c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb810ab9c824460bb21c9ba60e787529, user_id=bcac38a6452048bbbef6b778f3aa5c2f, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:12.374343 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0887bc9-fd58-40b3-8dc9-51ebfa960c6c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:12.386983 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1384/2760] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:12 2022] PUT /identity/v3/projects/cb810ab9c824460bb21c9ba60e787529/users/bcac38a6452048bbbef6b778f3aa5c2f/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:12.398687 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392a3ca-a6ac-455a-b987-ee9b8e6a9517 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:12.399060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392a3ca-a6ac-455a-b987-ee9b8e6a9517 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:12.399405 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392a3ca-a6ac-455a-b987-ee9b8e6a9517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:12.416468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23727b3-1d1c-4140-9392-39b2b4bc3166 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:12.428040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-3392a3ca-a6ac-455a-b987-ee9b8e6a9517 None None] MFA Rules not processed for user `bcac38a6452048bbbef6b778f3aa5c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:12.429257 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3392a3ca-a6ac-455a-b987-ee9b8e6a9517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:12.462349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:12.466851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef73a2f-ed63-4de0-ae4c-2e95d702221e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:12.467511 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef73a2f-ed63-4de0-ae4c-2e95d702221e service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:12.467791 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef73a2f-ed63-4de0-ae4c-2e95d702221e service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:12.468060 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef73a2f-ed63-4de0-ae4c-2e95d702221e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:12.469993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ef73a2f-ed63-4de0-ae4c-2e95d702221e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:12.491681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:12.501336 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1385/2761] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:12.512377 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392a3ca-a6ac-455a-b987-ee9b8e6a9517 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:12.513764 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-3392a3ca-a6ac-455a-b987-ee9b8e6a9517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:12.526600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392a3ca-a6ac-455a-b987-ee9b8e6a9517 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:12.531633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a2186-5850-4696-9db2-babbf1a851a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:12.532239 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2186-5850-4696-9db2-babbf1a851a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:12.532515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2186-5850-4696-9db2-babbf1a851a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:12.532784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2186-5850-4696-9db2-babbf1a851a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:12.537007 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef73a2f-ed63-4de0-ae4c-2e95d702221e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:12.538556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef73a2f-ed63-4de0-ae4c-2e95d702221e service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:12.542156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a2186-5850-4696-9db2-babbf1a851a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:12.543557 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a2186-5850-4696-9db2-babbf1a851a6 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:12.547514 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1377/2762] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:29:12.557724 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1386/2763] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:29:12.661846 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef73a2f-ed63-4de0-ae4c-2e95d702221e service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:12.671096 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef73a2f-ed63-4de0-ae4c-2e95d702221e service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:12.674789 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7fe537-4446-408f-8831-1b4896259811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:12.675383 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fe537-4446-408f-8831-1b4896259811 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:12.675665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fe537-4446-408f-8831-1b4896259811 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:12.675941 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fe537-4446-408f-8831-1b4896259811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:12.735556 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7fe537-4446-408f-8831-1b4896259811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:12.736984 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7fe537-4446-408f-8831-1b4896259811 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:12.746051 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1378/2764] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:14.665789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a2186-5850-4696-9db2-babbf1a851a6 service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:14.667213 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7c9a2186-5850-4696-9db2-babbf1a851a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:14.732068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a2186-5850-4696-9db2-babbf1a851a6 service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:14.736967 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:14.737616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:14.737898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:14.738203 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] PATH_INFO: `/v3/users/14a105a2668645cf8cd0119580171133` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:14.739344 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a105a2668645cf8cd0119580171133)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:14.741304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:14.787999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a105a2668645cf8cd0119580171133'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:14.794965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a105a2668645cf8cd0119580171133'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:14.806769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a105a2668645cf8cd0119580171133'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:14.814486 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a105a2668645cf8cd0119580171133'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:14.815129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a105a2668645cf8cd0119580171133'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:14.821138 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1387/2765] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:14 2022] DELETE /identity/v3/users/14a105a2668645cf8cd0119580171133 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:14.825539 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea201-d209-4695-80a3-53d79526bbe1 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:14.826064 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea201-d209-4695-80a3-53d79526bbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:14.826163 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeea201-d209-4695-80a3-53d79526bbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:14.846582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cbeea201-d209-4695-80a3-53d79526bbe1 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:14.847721 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cbeea201-d209-4695-80a3-53d79526bbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:14.905813 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1379/2766] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:14.915601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:14.916984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:14.957581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:14.976415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919a84f-c64e-4c44-bb35-a8964ccfbe3a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:14.979954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fe0c6-7106-4386-88cf-eea117a27d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:14.980546 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fe0c6-7106-4386-88cf-eea117a27d71 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:14.980822 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fe0c6-7106-4386-88cf-eea117a27d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:14.981090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fe0c6-7106-4386-88cf-eea117a27d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:14.990229 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fe0c6-7106-4386-88cf-eea117a27d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:14.991637 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fe0c6-7106-4386-88cf-eea117a27d71 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:15.001678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1388/2767] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:15.263626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeea201-d209-4695-80a3-53d79526bbe1 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:15.265039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cbeea201-d209-4695-80a3-53d79526bbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:15.276831 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeea201-d209-4695-80a3-53d79526bbe1 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:15.282395 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:15.283106 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:15.283491 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:15.283766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] PATH_INFO: `/v3/projects/378542d481ca44b7801f93892db039ba` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:15.285703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=378542d481ca44b7801f93892db039ba)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:15.287755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:15.337806 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378542d481ca44b7801f93892db039ba', 'request_id': 'req-745c19e8-3f65-4340-859d-7c7f4ec7c239'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.339240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fe0c6-7106-4386-88cf-eea117a27d71 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:15.340726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef5fe0c6-7106-4386-88cf-eea117a27d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:15.341798 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:15.344212 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378542d481ca44b7801f93892db039ba', 'request_id': 'req-745c19e8-3f65-4340-859d-7c7f4ec7c239'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.353203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378542d481ca44b7801f93892db039ba', 'request_id': 'req-745c19e8-3f65-4340-859d-7c7f4ec7c239'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.355628 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fe0c6-7106-4386-88cf-eea117a27d71 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:15.364724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] The token cache is being invalidate because project 378542d481ca44b7801f93892db039ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:15.365016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.365648 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.367159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1380/2768] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:15 2022] DELETE /identity/v3/projects/378542d481ca44b7801f93892db039ba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:15.371204 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:15.372549 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:15.418342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef264a9-4cec-4816-9356-52a3b7f81569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:15.418894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef264a9-4cec-4816-9356-52a3b7f81569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:15.419174 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef264a9-4cec-4816-9356-52a3b7f81569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:15.419455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef264a9-4cec-4816-9356-52a3b7f81569 admin admin] PATH_INFO: `/v3/users/961cda15d3074bae8962f649fb7d3db3` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:15.420613 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef264a9-4cec-4816-9356-52a3b7f81569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=961cda15d3074bae8962f649fb7d3db3)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:15.422578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef264a9-4cec-4816-9356-52a3b7f81569 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:15.436704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c19e8-3f65-4340-859d-7c7f4ec7c239 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:15.441261 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:15.441998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:15.442308 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:15.442577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] PATH_INFO: `/v3/users/69c03aa1f05642bc8940720165e694d4` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:15.444252 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c03aa1f05642bc8940720165e694d4)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:15.445755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:15.470006 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ef264a9-4cec-4816-9356-52a3b7f81569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961cda15d3074bae8962f649fb7d3db3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.477605 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ef264a9-4cec-4816-9356-52a3b7f81569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961cda15d3074bae8962f649fb7d3db3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.490960 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ef264a9-4cec-4816-9356-52a3b7f81569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961cda15d3074bae8962f649fb7d3db3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.494288 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c03aa1f05642bc8940720165e694d4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.495418 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c03aa1f05642bc8940720165e694d4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.496098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c03aa1f05642bc8940720165e694d4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.499474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ef264a9-4cec-4816-9356-52a3b7f81569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961cda15d3074bae8962f649fb7d3db3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.500227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5ef264a9-4cec-4816-9356-52a3b7f81569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961cda15d3074bae8962f649fb7d3db3'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.503495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c03aa1f05642bc8940720165e694d4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.507260 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1389/2769] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:15 2022] DELETE /identity/v3/users/961cda15d3074bae8962f649fb7d3db3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:29:15.511297 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a4038-da9d-454e-9f5c-70bc5dde9cee None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:15.511581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a4038-da9d-454e-9f5c-70bc5dde9cee None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:15.511854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a4038-da9d-454e-9f5c-70bc5dde9cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:15.512910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c03aa1f05642bc8940720165e694d4'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:15.531704 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1381/2770] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:15 2022] DELETE /identity/v3/users/69c03aa1f05642bc8940720165e694d4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:15.534671 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a04a4038-da9d-454e-9f5c-70bc5dde9cee None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:15.535886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a04a4038-da9d-454e-9f5c-70bc5dde9cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:15.589345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:15.604240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1390/2771] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:15.611533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:15.613151 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:15.674105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8e23f-9e2d-464d-8fae-9c5a16932637 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:15.677979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94881de1-5f10-4b34-a34e-08459e516c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:15.678745 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881de1-5f10-4b34-a34e-08459e516c1c service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:15.679027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881de1-5f10-4b34-a34e-08459e516c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:15.679301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94881de1-5f10-4b34-a34e-08459e516c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:15.692295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94881de1-5f10-4b34-a34e-08459e516c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:15.693799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94881de1-5f10-4b34-a34e-08459e516c1c service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:15.704814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1382/2772] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:15.919499 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a4038-da9d-454e-9f5c-70bc5dde9cee None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:15.921567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a04a4038-da9d-454e-9f5c-70bc5dde9cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:15.939996 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a4038-da9d-454e-9f5c-70bc5dde9cee None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:15.945670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:15.946838 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:15.947292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:15.947734 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] PATH_INFO: `/v3/projects/e40512c7e5144764a6c49e56837362bb` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:15.949125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40512c7e5144764a6c49e56837362bb)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:15.951475 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:16.003329 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40512c7e5144764a6c49e56837362bb', 'request_id': 'req-14bcc9fb-6701-45af-94e0-47586e64386c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.008898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40512c7e5144764a6c49e56837362bb', 'request_id': 'req-14bcc9fb-6701-45af-94e0-47586e64386c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.016460 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40512c7e5144764a6c49e56837362bb', 'request_id': 'req-14bcc9fb-6701-45af-94e0-47586e64386c'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.027814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] The token cache is being invalidate because project e40512c7e5144764a6c49e56837362bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:16.028108 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.028811 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.033799 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1391/2773] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:15 2022] DELETE /identity/v3/projects/e40512c7e5144764a6c49e56837362bb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:16.035029 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94881de1-5f10-4b34-a34e-08459e516c1c service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:16.041105 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:16.046122 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94881de1-5f10-4b34-a34e-08459e516c1c service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:16.067947 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:16.069830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:16.114919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:16.115577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:16.115855 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:16.116126 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] PATH_INFO: `/v3/users/55aedc21f6564641af562f236bbbefea` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:16.117249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=55aedc21f6564641af562f236bbbefea)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:16.119298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:16.143892 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcc9fb-6701-45af-94e0-47586e64386c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:16.149675 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:16.150346 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:16.150810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:16.150990 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] PATH_INFO: `/v3/projects/891741d47147433a9330747a0120212a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:16.152232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891741d47147433a9330747a0120212a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:16.154281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:16.166103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55aedc21f6564641af562f236bbbefea'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.166760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55aedc21f6564641af562f236bbbefea'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.167388 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55aedc21f6564641af562f236bbbefea'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.175320 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55aedc21f6564641af562f236bbbefea'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.182555 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55aedc21f6564641af562f236bbbefea'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.201702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1383/2774] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:16 2022] DELETE /identity/v3/users/55aedc21f6564641af562f236bbbefea => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:16.202928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891741d47147433a9330747a0120212a', 'request_id': 'req-de15152e-a763-4f62-b39a-74623aa978e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.208363 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891741d47147433a9330747a0120212a', 'request_id': 'req-de15152e-a763-4f62-b39a-74623aa978e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.215791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891741d47147433a9330747a0120212a', 'request_id': 'req-de15152e-a763-4f62-b39a-74623aa978e6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.228335 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] The token cache is being invalidate because project 891741d47147433a9330747a0120212a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:16.228626 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.229351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.230889 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1392/2775] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:16 2022] DELETE /identity/v3/projects/891741d47147433a9330747a0120212a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:29:16.235529 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:16.236950 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:16.304787 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4300f38-289c-4335-90fe-270c523100aa admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:16.312962 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:16.313611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:16.313892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:16.314271 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] PATH_INFO: `/v3/users/bcac38a6452048bbbef6b778f3aa5c2f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:16.315716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcac38a6452048bbbef6b778f3aa5c2f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:16.317708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:16.348104 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:16.374230 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcac38a6452048bbbef6b778f3aa5c2f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.374973 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcac38a6452048bbbef6b778f3aa5c2f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.375629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcac38a6452048bbbef6b778f3aa5c2f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.383502 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcac38a6452048bbbef6b778f3aa5c2f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.391286 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcac38a6452048bbbef6b778f3aa5c2f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.410365 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1384/2776] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:16 2022] DELETE /identity/v3/users/bcac38a6452048bbbef6b778f3aa5c2f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:29:16.492871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:16.494341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:16.513185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:16.592995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15152e-a763-4f62-b39a-74623aa978e6 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:16.650283 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:16.650914 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:16.651200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:16.651473 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] PATH_INFO: `/v3/projects/0739a824af9a46c3943a2e91a66f30a9` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:16.652719 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0739a824af9a46c3943a2e91a66f30a9)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:16.655723 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:16.706544 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:16.708209 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0739a824af9a46c3943a2e91a66f30a9', 'request_id': 'req-25e23d3a-cd54-422f-b8a4-8162a8958034'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.708501 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:16.714277 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0739a824af9a46c3943a2e91a66f30a9', 'request_id': 'req-25e23d3a-cd54-422f-b8a4-8162a8958034'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.727179 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0739a824af9a46c3943a2e91a66f30a9', 'request_id': 'req-25e23d3a-cd54-422f-b8a4-8162a8958034'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.729967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b81b0a-b543-46c5-8b62-76bf64991851 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:16.744315 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] The token cache is being invalidate because project 0739a824af9a46c3943a2e91a66f30a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:16.744611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.745270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-25e23d3a-cd54-422f-b8a4-8162a8958034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.746798 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1393/2777] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:16 2022] DELETE /identity/v3/projects/0739a824af9a46c3943a2e91a66f30a9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:16.753932 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3897-bb21-4d7d-ab5e-1ed6e9904bf6 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:16.754256 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3897-bb21-4d7d-ab5e-1ed6e9904bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:16.754555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3897-bb21-4d7d-ab5e-1ed6e9904bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:16.774238 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-d93e3897-bb21-4d7d-ab5e-1ed6e9904bf6 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:16.775448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d93e3897-bb21-4d7d-ab5e-1ed6e9904bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:16.788112 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:16.788746 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:16.789025 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:16.789298 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] PATH_INFO: `/v3/projects/cb810ab9c824460bb21c9ba60e787529` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:16.790457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb810ab9c824460bb21c9ba60e787529)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:16.792362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:16.821463 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:16.839943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb810ab9c824460bb21c9ba60e787529', 'request_id': 'req-0c78eae5-effb-43eb-809d-aee9a07d6d1b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.840680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1394/2778] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:16.846635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb810ab9c824460bb21c9ba60e787529', 'request_id': 'req-0c78eae5-effb-43eb-809d-aee9a07d6d1b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.850157 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0cf7-4744-4342-9dc1-2dc11570f6e2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:16.850538 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0cf7-4744-4342-9dc1-2dc11570f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:16.850693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0cf7-4744-4342-9dc1-2dc11570f6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:16.854694 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb810ab9c824460bb21c9ba60e787529', 'request_id': 'req-0c78eae5-effb-43eb-809d-aee9a07d6d1b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.866602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] The token cache is being invalidate because project cb810ab9c824460bb21c9ba60e787529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:16.866884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.867523 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0c78eae5-effb-43eb-809d-aee9a07d6d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:16.868997 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1385/2779] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:16 2022] DELETE /identity/v3/projects/cb810ab9c824460bb21c9ba60e787529 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:29:16.872441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a77a0cf7-4744-4342-9dc1-2dc11570f6e2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:16.872441 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a77a0cf7-4744-4342-9dc1-2dc11570f6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:16.873862 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b681fdb-7745-437c-9a5e-5a27e4b68a02 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:16.874203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b681fdb-7745-437c-9a5e-5a27e4b68a02 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:16.874482 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b681fdb-7745-437c-9a5e-5a27e4b68a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:16.894358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8b681fdb-7745-437c-9a5e-5a27e4b68a02 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:16.895620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8b681fdb-7745-437c-9a5e-5a27e4b68a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:16.926558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:16.933354 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1395/2780] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:16.937438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a0cf7-4744-4342-9dc1-2dc11570f6e2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:16.946680 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a0cf7-4744-4342-9dc1-2dc11570f6e2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:16.951493 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a42f-79a4-4a69-aad6-684515273c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:16.952087 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a42f-79a4-4a69-aad6-684515273c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:16.952366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a42f-79a4-4a69-aad6-684515273c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:16.952636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19a42f-79a4-4a69-aad6-684515273c2c admin admin] PATH_INFO: `/v3/domains` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:16.953276 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19a42f-79a4-4a69-aad6-684515273c2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81449) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:29:16.953577 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19a42f-79a4-4a69-aad6-684515273c2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:16.955205 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19a42f-79a4-4a69-aad6-684515273c2c admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:16.961377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1386/2781] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:16.967857 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1396/2782] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:29:16.969649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece6624-37a5-4df2-a367-f1bbbffbbfd4 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:16.969955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece6624-37a5-4df2-a367-f1bbbffbbfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:16.970256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece6624-37a5-4df2-a367-f1bbbffbbfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:16.972021 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a42f-79a4-4a69-aad6-684515273c2c admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:16.981886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19a42f-79a4-4a69-aad6-684515273c2c admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:16.987778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71752ab2-eb28-42d6-9557-1e40d7adfde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:16.988322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71752ab2-eb28-42d6-9557-1e40d7adfde3 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:16.988587 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71752ab2-eb28-42d6-9557-1e40d7adfde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:16.988860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71752ab2-eb28-42d6-9557-1e40d7adfde3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:16.989481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71752ab2-eb28-42d6-9557-1e40d7adfde3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:16.990190 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-4ece6624-37a5-4df2-a367-f1bbbffbbfd4 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:16.991367 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-4ece6624-37a5-4df2-a367-f1bbbffbbfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:16.991474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71752ab2-eb28-42d6-9557-1e40d7adfde3 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:16.999239 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1387/2783] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:17.003624 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece6624-37a5-4df2-a367-f1bbbffbbfd4 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.013380 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece6624-37a5-4df2-a367-f1bbbffbbfd4 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.018054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2278b-1b49-4bd3-8af7-40980a7db1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.018645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2278b-1b49-4bd3-8af7-40980a7db1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.018924 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2278b-1b49-4bd3-8af7-40980a7db1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.019191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2278b-1b49-4bd3-8af7-40980a7db1e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.023141 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1397/2784] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:16 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:17.023268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2278b-1b49-4bd3-8af7-40980a7db1e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:29:17.023268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2278b-1b49-4bd3-8af7-40980a7db1e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.023268 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2278b-1b49-4bd3-8af7-40980a7db1e1 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.024050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71752ab2-eb28-42d6-9557-1e40d7adfde3 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.035522 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1388/2785] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 15:29:17.039598 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2278b-1b49-4bd3-8af7-40980a7db1e1 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.049807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2278b-1b49-4bd3-8af7-40980a7db1e1 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.086826 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71752ab2-eb28-42d6-9557-1e40d7adfde3 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.092681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de4ea6-c220-44ce-8b96-7ab6a0d671d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.093555 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de4ea6-c220-44ce-8b96-7ab6a0d671d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.093831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de4ea6-c220-44ce-8b96-7ab6a0d671d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.094135 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de4ea6-c220-44ce-8b96-7ab6a0d671d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.094758 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de4ea6-c220-44ce-8b96-7ab6a0d671d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.097016 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de4ea6-c220-44ce-8b96-7ab6a0d671d1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.106216 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a692846-5a61-43ac-8a05-e04645c3834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.106829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692846-5a61-43ac-8a05-e04645c3834b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.107110 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692846-5a61-43ac-8a05-e04645c3834b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.107462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692846-5a61-43ac-8a05-e04645c3834b admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.108030 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a692846-5a61-43ac-8a05-e04645c3834b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.109960 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a692846-5a61-43ac-8a05-e04645c3834b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.118378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1398/2786] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:17 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:29:17.122412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de4ea6-c220-44ce-8b96-7ab6a0d671d1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.132531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de4ea6-c220-44ce-8b96-7ab6a0d671d1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.140857 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1389/2787] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:17 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:29:17.141007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9ffb-10bd-4d4d-b9a0-df92c5993d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.141007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9ffb-10bd-4d4d-b9a0-df92c5993d5f admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.141007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9ffb-10bd-4d4d-b9a0-df92c5993d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.141007 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a9ffb-10bd-4d4d-b9a0-df92c5993d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.141348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9ffb-10bd-4d4d-b9a0-df92c5993d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.141348 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a9ffb-10bd-4d4d-b9a0-df92c5993d5f admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.141786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a692846-5a61-43ac-8a05-e04645c3834b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.151566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1399/2788] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:29:17.155935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9ffb-10bd-4d4d-b9a0-df92c5993d5f admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.165435 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a9ffb-10bd-4d4d-b9a0-df92c5993d5f admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.195332 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:17.211276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a692846-5a61-43ac-8a05-e04645c3834b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.216141 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b5c24-35e1-499d-9a16-c44a9ad30701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.216735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5c24-35e1-499d-9a16-c44a9ad30701 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.217635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5c24-35e1-499d-9a16-c44a9ad30701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.217895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b5c24-35e1-499d-9a16-c44a9ad30701 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.218550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b5c24-35e1-499d-9a16-c44a9ad30701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.220442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b5c24-35e1-499d-9a16-c44a9ad30701 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.224316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390049f7-c6aa-45db-96d0-a8dab7f08edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.224923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390049f7-c6aa-45db-96d0-a8dab7f08edd admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.225207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390049f7-c6aa-45db-96d0-a8dab7f08edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.225481 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390049f7-c6aa-45db-96d0-a8dab7f08edd admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.226165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390049f7-c6aa-45db-96d0-a8dab7f08edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.227748 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390049f7-c6aa-45db-96d0-a8dab7f08edd admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.238391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1400/2789] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:29:17.242360 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390049f7-c6aa-45db-96d0-a8dab7f08edd admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.247764 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1390/2790] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:17 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:17.248750 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b5c24-35e1-499d-9a16-c44a9ad30701 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.252400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390049f7-c6aa-45db-96d0-a8dab7f08edd admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.257243 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fed5b-398d-4d57-a0da-8d261472d214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.257886 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fed5b-398d-4d57-a0da-8d261472d214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.258215 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fed5b-398d-4d57-a0da-8d261472d214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.258322 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b5c24-35e1-499d-9a16-c44a9ad30701 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.258493 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fed5b-398d-4d57-a0da-8d261472d214 admin admin] PATH_INFO: `/v3/projects/2113ca9fa22043e3a91758df2e91ace6/users/631e841c2d80406184e7358788a4023a/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.263103 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72a894-9126-40df-9c8e-df5eb21e630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.263684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a894-9126-40df-9c8e-df5eb21e630c admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.264506 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a894-9126-40df-9c8e-df5eb21e630c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.264780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72a894-9126-40df-9c8e-df5eb21e630c admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.265416 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72a894-9126-40df-9c8e-df5eb21e630c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.267028 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72a894-9126-40df-9c8e-df5eb21e630c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.273512 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fed5b-398d-4d57-a0da-8d261472d214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2113ca9fa22043e3a91758df2e91ace6, user_id=631e841c2d80406184e7358788a4023a, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.276150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fed5b-398d-4d57-a0da-8d261472d214 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.280140 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1391/2791] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:17.281344 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72a894-9126-40df-9c8e-df5eb21e630c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.290527 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1401/2792] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:17 2022] PUT /identity/v3/projects/2113ca9fa22043e3a91758df2e91ace6/users/631e841c2d80406184e7358788a4023a/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:17.292991 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72a894-9126-40df-9c8e-df5eb21e630c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.303975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6927-f588-4126-b41b-df197f9ff740 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.304349 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6927-f588-4126-b41b-df197f9ff740 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.304715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde6927-f588-4126-b41b-df197f9ff740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.307871 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:17.335326 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-6cde6927-f588-4126-b41b-df197f9ff740 None None] MFA Rules not processed for user `631e841c2d80406184e7358788a4023a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:17.336863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6cde6927-f588-4126-b41b-df197f9ff740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:17.354464 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a9f5e-0661-46a1-93f2-5e741bfc9a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.355079 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a9f5e-0661-46a1-93f2-5e741bfc9a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.355362 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a9f5e-0661-46a1-93f2-5e741bfc9a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.355639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a9f5e-0661-46a1-93f2-5e741bfc9a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.356295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a9f5e-0661-46a1-93f2-5e741bfc9a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.357883 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a9f5e-0661-46a1-93f2-5e741bfc9a31 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.369658 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1392/2793] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:29:17.374436 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a9f5e-0661-46a1-93f2-5e741bfc9a31 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.384317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a9f5e-0661-46a1-93f2-5e741bfc9a31 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.389713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2062d8-4407-4c9f-b4b2-893b602b9378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.390373 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2062d8-4407-4c9f-b4b2-893b602b9378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.390656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2062d8-4407-4c9f-b4b2-893b602b9378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.390925 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2062d8-4407-4c9f-b4b2-893b602b9378 admin admin] PATH_INFO: `/v3/projects/3b30b053cc564a75a2760095336a96e5/users/f4eff3eb2f774235b0c834ca38d887e7/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.404040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1402/2794] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:17.406185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2062d8-4407-4c9f-b4b2-893b602b9378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b30b053cc564a75a2760095336a96e5, user_id=f4eff3eb2f774235b0c834ca38d887e7, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.408843 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2062d8-4407-4c9f-b4b2-893b602b9378 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.416008 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde6927-f588-4126-b41b-df197f9ff740 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.417698 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6cde6927-f588-4126-b41b-df197f9ff740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:17.422838 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1393/2795] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:17 2022] PUT /identity/v3/projects/3b30b053cc564a75a2760095336a96e5/users/f4eff3eb2f774235b0c834ca38d887e7/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:29:17.433091 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f4dba-63e7-4a4b-a30a-b615c552cd78 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.433406 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f4dba-63e7-4a4b-a30a-b615c552cd78 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.433687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f4dba-63e7-4a4b-a30a-b615c552cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.461769 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-191f4dba-63e7-4a4b-a30a-b615c552cd78 None None] MFA Rules not processed for user `f4eff3eb2f774235b0c834ca38d887e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:17.463034 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-191f4dba-63e7-4a4b-a30a-b615c552cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:17.474627 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde6927-f588-4126-b41b-df197f9ff740 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.523780 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed57ccc-549e-47d4-a7d7-806812b293df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.524395 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed57ccc-549e-47d4-a7d7-806812b293df service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.524681 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed57ccc-549e-47d4-a7d7-806812b293df service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.524961 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed57ccc-549e-47d4-a7d7-806812b293df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.529543 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:17.530377 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1394/2796] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:17.534967 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f4dba-63e7-4a4b-a30a-b615c552cd78 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.590310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed57ccc-549e-47d4-a7d7-806812b293df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.591768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed57ccc-549e-47d4-a7d7-806812b293df service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.600956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f4dba-63e7-4a4b-a30a-b615c552cd78 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.601168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1403/2797] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:29:17.605864 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc658c-a58b-4f18-b170-3c0c8d9c8b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.606503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc658c-a58b-4f18-b170-3c0c8d9c8b70 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.606783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc658c-a58b-4f18-b170-3c0c8d9c8b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.607047 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc658c-a58b-4f18-b170-3c0c8d9c8b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.607726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc658c-a58b-4f18-b170-3c0c8d9c8b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.609602 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc658c-a58b-4f18-b170-3c0c8d9c8b70 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.641639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1395/2798] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:17 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:29:17.642986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed57ccc-549e-47d4-a7d7-806812b293df service cinder] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.654331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed57ccc-549e-47d4-a7d7-806812b293df service cinder] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.713600 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2966e44-7a9d-4a08-a65a-d9ddefdaf6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.714246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2966e44-7a9d-4a08-a65a-d9ddefdaf6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.714529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2966e44-7a9d-4a08-a65a-d9ddefdaf6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.714807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2966e44-7a9d-4a08-a65a-d9ddefdaf6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.715427 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2966e44-7a9d-4a08-a65a-d9ddefdaf6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.717369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2966e44-7a9d-4a08-a65a-d9ddefdaf6d5 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.742068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1404/2799] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:17 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:17.745144 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc658c-a58b-4f18-b170-3c0c8d9c8b70 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.753262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:17.757542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc658c-a58b-4f18-b170-3c0c8d9c8b70 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.764483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db11667-3c82-4aef-b135-33371d3d2141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.765645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11667-3c82-4aef-b135-33371d3d2141 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.765981 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11667-3c82-4aef-b135-33371d3d2141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.766348 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db11667-3c82-4aef-b135-33371d3d2141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.767092 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db11667-3c82-4aef-b135-33371d3d2141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.768766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db11667-3c82-4aef-b135-33371d3d2141 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.780021 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1396/2800] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:29:17.783976 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2966e44-7a9d-4a08-a65a-d9ddefdaf6d5 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.794938 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2966e44-7a9d-4a08-a65a-d9ddefdaf6d5 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.799863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4dacc-ce11-4851-b038-d7b27bfc394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.800572 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4dacc-ce11-4851-b038-d7b27bfc394b admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.800918 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4dacc-ce11-4851-b038-d7b27bfc394b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.801261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4dacc-ce11-4851-b038-d7b27bfc394b admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.801977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4dacc-ce11-4851-b038-d7b27bfc394b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.803672 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4dacc-ce11-4851-b038-d7b27bfc394b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.815156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1405/2801] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:17.819410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db11667-3c82-4aef-b135-33371d3d2141 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:17.830115 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db11667-3c82-4aef-b135-33371d3d2141 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:17.835147 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f2adc-83a1-4567-8199-ff03efae8407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:17.836165 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2adc-83a1-4567-8199-ff03efae8407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.836862 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2adc-83a1-4567-8199-ff03efae8407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.837368 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2adc-83a1-4567-8199-ff03efae8407 admin admin] PATH_INFO: `/v3/projects/cede986c22bb47338d3bc595097706ac/users/cd1e9a362e4841d8bee1e773e29125ba/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.855957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f2adc-83a1-4567-8199-ff03efae8407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cede986c22bb47338d3bc595097706ac, user_id=cd1e9a362e4841d8bee1e773e29125ba, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:17.859078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f2adc-83a1-4567-8199-ff03efae8407 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:17.873125 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1397/2802] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:17 2022] PUT /identity/v3/projects/cede986c22bb47338d3bc595097706ac/users/cd1e9a362e4841d8bee1e773e29125ba/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:17.885373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11d363-d85c-4c87-aefc-bb983d68df15 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:17.885601 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11d363-d85c-4c87-aefc-bb983d68df15 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:17.885879 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11d363-d85c-4c87-aefc-bb983d68df15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:17.918281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-bf11d363-d85c-4c87-aefc-bb983d68df15 None None] MFA Rules not processed for user `cd1e9a362e4841d8bee1e773e29125ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:17.919594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bf11d363-d85c-4c87-aefc-bb983d68df15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:17.987191 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1406/2803] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:17.991749 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f2adc-83a1-4567-8199-ff03efae8407 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:18.053425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f2adc-83a1-4567-8199-ff03efae8407 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:18.058098 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848ad7b-942f-47b9-9ff7-72a640e84d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:18.058716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ad7b-942f-47b9-9ff7-72a640e84d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:18.058987 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ad7b-942f-47b9-9ff7-72a640e84d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:18.059260 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848ad7b-942f-47b9-9ff7-72a640e84d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:18.059875 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848ad7b-942f-47b9-9ff7-72a640e84d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:18.062444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848ad7b-942f-47b9-9ff7-72a640e84d7c admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:18.087766 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1398/2804] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:17 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:29:18.091793 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11d363-d85c-4c87-aefc-bb983d68df15 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:18.104661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11d363-d85c-4c87-aefc-bb983d68df15 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:18.114564 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:18.162539 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37649ebc-65ef-40f3-83b5-de5e8b81019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:18.163142 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649ebc-65ef-40f3-83b5-de5e8b81019b admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:18.163425 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649ebc-65ef-40f3-83b5-de5e8b81019b admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:18.163703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649ebc-65ef-40f3-83b5-de5e8b81019b admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:18.164322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37649ebc-65ef-40f3-83b5-de5e8b81019b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:18.166241 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37649ebc-65ef-40f3-83b5-de5e8b81019b admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:18.187665 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1407/2805] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:18 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 15:29:18.191748 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848ad7b-942f-47b9-9ff7-72a640e84d7c admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:18.202076 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848ad7b-942f-47b9-9ff7-72a640e84d7c admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:18.207124 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1639c3-7cf0-4b86-80b7-cecfb037b48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:18.207713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1639c3-7cf0-4b86-80b7-cecfb037b48b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:18.207993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1639c3-7cf0-4b86-80b7-cecfb037b48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:18.208265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1639c3-7cf0-4b86-80b7-cecfb037b48b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:18.208937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1639c3-7cf0-4b86-80b7-cecfb037b48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:18.210551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1639c3-7cf0-4b86-80b7-cecfb037b48b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:18.221710 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1399/2806] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:18.225806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37649ebc-65ef-40f3-83b5-de5e8b81019b admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:18.236222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37649ebc-65ef-40f3-83b5-de5e8b81019b admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:18.240840 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbffc03-5764-4d86-9185-75061eec8611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:18.241479 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbffc03-5764-4d86-9185-75061eec8611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:18.241762 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbffc03-5764-4d86-9185-75061eec8611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:18.242060 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbffc03-5764-4d86-9185-75061eec8611 admin admin] PATH_INFO: `/v3/projects/3b55b08b0be4479692d78fb9b61369d2/users/4c82f56097374d76a899ab9dc62a474b/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:18.256467 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbffc03-5764-4d86-9185-75061eec8611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b55b08b0be4479692d78fb9b61369d2, user_id=4c82f56097374d76a899ab9dc62a474b, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:18.259147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbffc03-5764-4d86-9185-75061eec8611 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:18.271557 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1408/2807] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:18 2022] PUT /identity/v3/projects/3b55b08b0be4479692d78fb9b61369d2/users/4c82f56097374d76a899ab9dc62a474b/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:18.275495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1639c3-7cf0-4b86-80b7-cecfb037b48b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:18.287113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1639c3-7cf0-4b86-80b7-cecfb037b48b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:18.348517 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fbf46-7b85-4012-aca3-6d5798a6db1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:18.349042 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fbf46-7b85-4012-aca3-6d5798a6db1b admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:18.349323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fbf46-7b85-4012-aca3-6d5798a6db1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:18.349594 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fbf46-7b85-4012-aca3-6d5798a6db1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:18.350264 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fbf46-7b85-4012-aca3-6d5798a6db1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:18.351845 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fbf46-7b85-4012-aca3-6d5798a6db1b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:18.361611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1400/2808] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:29:18.366011 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbffc03-5764-4d86-9185-75061eec8611 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:18.377240 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbffc03-5764-4d86-9185-75061eec8611 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:18.381965 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497843c-8d59-4cef-a6a2-03f3a900e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:18.382653 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497843c-8d59-4cef-a6a2-03f3a900e148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:18.382936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497843c-8d59-4cef-a6a2-03f3a900e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:18.383210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497843c-8d59-4cef-a6a2-03f3a900e148 admin admin] PATH_INFO: `/v3/projects/3b55b08b0be4479692d78fb9b61369d2/users/4c82f56097374d76a899ab9dc62a474b/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:18.385151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497843c-8d59-4cef-a6a2-03f3a900e148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b55b08b0be4479692d78fb9b61369d2, user_id=4c82f56097374d76a899ab9dc62a474b, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:18.387827 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497843c-8d59-4cef-a6a2-03f3a900e148 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:18.399466 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1409/2809] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:18 2022] PUT /identity/v3/projects/3b55b08b0be4479692d78fb9b61369d2/users/4c82f56097374d76a899ab9dc62a474b/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:18.409850 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffd910-b5f9-4755-870a-afe8d93b5cc5 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:18.410174 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffd910-b5f9-4755-870a-afe8d93b5cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:18.410454 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffd910-b5f9-4755-870a-afe8d93b5cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:18.439083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-68ffd910-b5f9-4755-870a-afe8d93b5cc5 None None] MFA Rules not processed for user `4c82f56097374d76a899ab9dc62a474b`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:18.440314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-68ffd910-b5f9-4755-870a-afe8d93b5cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:18.470045 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:18.512988 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1401/2810] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:18.528350 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497843c-8d59-4cef-a6a2-03f3a900e148 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:18.584132 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497843c-8d59-4cef-a6a2-03f3a900e148 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:18.587881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9995c26-e5dd-4313-9b47-721adba7dc89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:18.588491 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995c26-e5dd-4313-9b47-721adba7dc89 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:18.588769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995c26-e5dd-4313-9b47-721adba7dc89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:18.589038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9995c26-e5dd-4313-9b47-721adba7dc89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:18.598651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9995c26-e5dd-4313-9b47-721adba7dc89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:18.600010 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9995c26-e5dd-4313-9b47-721adba7dc89 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:18.609936 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1410/2811] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:18.650571 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffd910-b5f9-4755-870a-afe8d93b5cc5 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:18.651942 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-68ffd910-b5f9-4755-870a-afe8d93b5cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:18.663993 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffd910-b5f9-4755-870a-afe8d93b5cc5 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:18.667547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafea92-c038-47c5-87db-4230458f7433 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:18.668154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafea92-c038-47c5-87db-4230458f7433 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:18.668628 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafea92-c038-47c5-87db-4230458f7433 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:18.668818 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafea92-c038-47c5-87db-4230458f7433 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:18.726074 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafea92-c038-47c5-87db-4230458f7433 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:18.727519 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafea92-c038-47c5-87db-4230458f7433 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:18.736884 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1402/2812] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:19.038168 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad2117-3dd4-4632-9fb6-0f9de7abc6e5 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:19.038661 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad2117-3dd4-4632-9fb6-0f9de7abc6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:19.038777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad2117-3dd4-4632-9fb6-0f9de7abc6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:19.058944 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-7bad2117-3dd4-4632-9fb6-0f9de7abc6e5 None None] MFA Rules not processed for user `631e841c2d80406184e7358788a4023a`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:19.060165 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7bad2117-3dd4-4632-9fb6-0f9de7abc6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:19.134847 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1411/2813] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:21.632189 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafea92-c038-47c5-87db-4230458f7433 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:21.697256 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafea92-c038-47c5-87db-4230458f7433 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:21.703225 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:21.703631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:21.703914 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:21.704191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] PATH_INFO: `/v3/users/f4eff3eb2f774235b0c834ca38d887e7` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:21.705635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4eff3eb2f774235b0c834ca38d887e7)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:21.707620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:21.756245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4eff3eb2f774235b0c834ca38d887e7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:21.756919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4eff3eb2f774235b0c834ca38d887e7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:21.757533 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4eff3eb2f774235b0c834ca38d887e7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:21.765943 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4eff3eb2f774235b0c834ca38d887e7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:21.773509 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4eff3eb2f774235b0c834ca38d887e7'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:21.775452 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:21.801728 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1403/2814] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:21 2022] DELETE /identity/v3/users/f4eff3eb2f774235b0c834ca38d887e7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:21.803359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd865-a042-4687-a3f4-cf97a2e7b774 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:21.804272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd865-a042-4687-a3f4-cf97a2e7b774 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:21.804647 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dd865-a042-4687-a3f4-cf97a2e7b774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:21.824981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-e79dd865-a042-4687-a3f4-cf97a2e7b774 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:21.825756 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e79dd865-a042-4687-a3f4-cf97a2e7b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:21.836182 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:21.928523 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1412/2815] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:21.941673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:21.943603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:22.018641 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a11cd0-3559-4b09-aab0-30315d3bac1d admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:22.022702 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d15f2-8b46-424c-8408-93d2068bb0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:22.023376 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d15f2-8b46-424c-8408-93d2068bb0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:22.023684 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d15f2-8b46-424c-8408-93d2068bb0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:22.024209 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d15f2-8b46-424c-8408-93d2068bb0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:22.034589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d15f2-8b46-424c-8408-93d2068bb0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:22.036078 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d15f2-8b46-424c-8408-93d2068bb0f6 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:22.046955 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1404/2816] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:22.486953 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd865-a042-4687-a3f4-cf97a2e7b774 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:22.488424 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-e79dd865-a042-4687-a3f4-cf97a2e7b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:22.501295 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dd865-a042-4687-a3f4-cf97a2e7b774 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:22.506216 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:22.506868 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:22.507150 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:22.507428 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] PATH_INFO: `/v3/projects/3b30b053cc564a75a2760095336a96e5` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:22.514691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b30b053cc564a75a2760095336a96e5)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:22.517469 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:22.578237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b30b053cc564a75a2760095336a96e5', 'request_id': 'req-001dd107-2e84-409e-ac29-cffabe2dee17'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:22.584984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b30b053cc564a75a2760095336a96e5', 'request_id': 'req-001dd107-2e84-409e-ac29-cffabe2dee17'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:22.593810 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b30b053cc564a75a2760095336a96e5', 'request_id': 'req-001dd107-2e84-409e-ac29-cffabe2dee17'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:22.606507 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] The token cache is being invalidate because project 3b30b053cc564a75a2760095336a96e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:22.606722 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:22.607412 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:22.609455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1413/2817] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:22 2022] DELETE /identity/v3/projects/3b30b053cc564a75a2760095336a96e5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:22.613451 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d15f2-8b46-424c-8408-93d2068bb0f6 service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:22.623213 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d15f2-8b46-424c-8408-93d2068bb0f6 service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:22.683275 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:22.683996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:22.684276 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:22.684547 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] PATH_INFO: `/v3/users/cd1e9a362e4841d8bee1e773e29125ba` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:22.685732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1e9a362e4841d8bee1e773e29125ba)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:22.688415 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:22.744372 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1e9a362e4841d8bee1e773e29125ba'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:22.745027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1e9a362e4841d8bee1e773e29125ba'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:22.745632 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1e9a362e4841d8bee1e773e29125ba'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:22.752952 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1e9a362e4841d8bee1e773e29125ba'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:22.760382 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1e9a362e4841d8bee1e773e29125ba'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:22.777489 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1405/2818] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:22 2022] DELETE /identity/v3/users/cd1e9a362e4841d8bee1e773e29125ba => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:23.107656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:23.109206 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:23.123784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dd107-2e84-409e-ac29-cffabe2dee17 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:23.200871 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:23.201509 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:23.202373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:23.202645 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] PATH_INFO: `/v3/projects/cede986c22bb47338d3bc595097706ac` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:23.203801 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cede986c22bb47338d3bc595097706ac)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:23.205727 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:23.245594 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:23.254285 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cede986c22bb47338d3bc595097706ac', 'request_id': 'req-b39fcfd8-bed1-457d-bb88-f59715383c80'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.259923 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cede986c22bb47338d3bc595097706ac', 'request_id': 'req-b39fcfd8-bed1-457d-bb88-f59715383c80'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.267407 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cede986c22bb47338d3bc595097706ac', 'request_id': 'req-b39fcfd8-bed1-457d-bb88-f59715383c80'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.278411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] The token cache is being invalidate because project cede986c22bb47338d3bc595097706ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:23.278704 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.279330 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.281478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1414/2819] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:23 2022] DELETE /identity/v3/projects/cede986c22bb47338d3bc595097706ac => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:23.285457 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:23.286888 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:23.295852 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:23.299956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067b163-902a-4671-977a-98bc6eec24a0 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:23.358020 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c656bf-b77b-4575-ad9b-4356588d00ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:23.358796 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c656bf-b77b-4575-ad9b-4356588d00ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:23.359090 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c656bf-b77b-4575-ad9b-4356588d00ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:23.359356 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c656bf-b77b-4575-ad9b-4356588d00ea admin admin] PATH_INFO: `/v3/users/4c82f56097374d76a899ab9dc62a474b` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:23.360479 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c656bf-b77b-4575-ad9b-4356588d00ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c82f56097374d76a899ab9dc62a474b)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:23.362430 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c656bf-b77b-4575-ad9b-4356588d00ea admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:23.408169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-47c656bf-b77b-4575-ad9b-4356588d00ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c82f56097374d76a899ab9dc62a474b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.408723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-47c656bf-b77b-4575-ad9b-4356588d00ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c82f56097374d76a899ab9dc62a474b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.409312 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-47c656bf-b77b-4575-ad9b-4356588d00ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c82f56097374d76a899ab9dc62a474b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.416611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-47c656bf-b77b-4575-ad9b-4356588d00ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c82f56097374d76a899ab9dc62a474b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.423495 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-47c656bf-b77b-4575-ad9b-4356588d00ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c82f56097374d76a899ab9dc62a474b'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.440627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1406/2820] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:23 2022] DELETE /identity/v3/users/4c82f56097374d76a899ab9dc62a474b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:23.718292 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:23.719860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:23.733625 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fcfd8-bed1-457d-bb88-f59715383c80 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:23.790784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:23.791414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:23.791692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:23.791964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] PATH_INFO: `/v3/projects/3b55b08b0be4479692d78fb9b61369d2` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:23.793064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b55b08b0be4479692d78fb9b61369d2)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:23.795009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:23.843099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b55b08b0be4479692d78fb9b61369d2', 'request_id': 'req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.849353 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b55b08b0be4479692d78fb9b61369d2', 'request_id': 'req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.856669 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b55b08b0be4479692d78fb9b61369d2', 'request_id': 'req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.868673 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] The token cache is being invalidate because project 3b55b08b0be4479692d78fb9b61369d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:23.868964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.869604 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-9d15cfb8-0bfc-4a97-8fe7-541c8950aee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:23.871120 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1415/2821] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:23 2022] DELETE /identity/v3/projects/3b55b08b0be4479692d78fb9b61369d2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:23.877644 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996fe3-f981-4f5f-b993-f1619b2c177f None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:23.878148 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996fe3-f981-4f5f-b993-f1619b2c177f None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:23.878283 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94996fe3-f981-4f5f-b993-f1619b2c177f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:23.897493 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-94996fe3-f981-4f5f-b993-f1619b2c177f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:23.898734 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-94996fe3-f981-4f5f-b993-f1619b2c177f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:23.957334 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1407/2822] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:23.965498 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9a048-f283-48da-8504-98a3e3cbf0c2 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:23.965785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9a048-f283-48da-8504-98a3e3cbf0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:23.966090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9a048-f283-48da-8504-98a3e3cbf0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:23.986786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-a6b9a048-f283-48da-8504-98a3e3cbf0c2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:23.988018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-a6b9a048-f283-48da-8504-98a3e3cbf0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:23.995977 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1416/2823] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:24.000823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94996fe3-f981-4f5f-b993-f1619b2c177f None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.010559 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94996fe3-f981-4f5f-b993-f1619b2c177f None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.015169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2c27d-e33c-4d81-b71d-7cb3a79bc257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.015762 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2c27d-e33c-4d81-b71d-7cb3a79bc257 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.016043 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2c27d-e33c-4d81-b71d-7cb3a79bc257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.016316 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2c27d-e33c-4d81-b71d-7cb3a79bc257 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.016959 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2c27d-e33c-4d81-b71d-7cb3a79bc257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:29:24.017265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2c27d-e33c-4d81-b71d-7cb3a79bc257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.018895 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2c27d-e33c-4d81-b71d-7cb3a79bc257 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.030358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1408/2824] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:29:24.034750 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9a048-f283-48da-8504-98a3e3cbf0c2 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.043863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9a048-f283-48da-8504-98a3e3cbf0c2 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.048947 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eb0d3-d59c-403a-aa73-789d0fce5d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.049536 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb0d3-d59c-403a-aa73-789d0fce5d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.049817 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb0d3-d59c-403a-aa73-789d0fce5d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.050121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eb0d3-d59c-403a-aa73-789d0fce5d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.050740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825eb0d3-d59c-403a-aa73-789d0fce5d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.052633 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825eb0d3-d59c-403a-aa73-789d0fce5d9a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.078980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1417/2825] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:24 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:24.082996 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2c27d-e33c-4d81-b71d-7cb3a79bc257 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.093073 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2c27d-e33c-4d81-b71d-7cb3a79bc257 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.101589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:24.153928 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69dcf5-78b6-4025-a760-af9d48255619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.154650 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69dcf5-78b6-4025-a760-af9d48255619 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.154933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69dcf5-78b6-4025-a760-af9d48255619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.155205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69dcf5-78b6-4025-a760-af9d48255619 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.155837 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69dcf5-78b6-4025-a760-af9d48255619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.157743 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69dcf5-78b6-4025-a760-af9d48255619 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.182696 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1409/2826] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:24 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:24.183616 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eb0d3-d59c-403a-aa73-789d0fce5d9a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.194852 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825eb0d3-d59c-403a-aa73-789d0fce5d9a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.199614 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0189ad-b098-4b29-9d50-97f92c21af26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.200228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0189ad-b098-4b29-9d50-97f92c21af26 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.200510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0189ad-b098-4b29-9d50-97f92c21af26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.200790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0189ad-b098-4b29-9d50-97f92c21af26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.201432 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0189ad-b098-4b29-9d50-97f92c21af26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.203107 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0189ad-b098-4b29-9d50-97f92c21af26 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.214001 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1418/2827] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:29:24.218473 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69dcf5-78b6-4025-a760-af9d48255619 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.229156 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69dcf5-78b6-4025-a760-af9d48255619 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.234442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda90b00-6da9-4648-8e53-053210d5b21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.235049 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90b00-6da9-4648-8e53-053210d5b21f admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.235326 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90b00-6da9-4648-8e53-053210d5b21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.235597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda90b00-6da9-4648-8e53-053210d5b21f admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.236244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda90b00-6da9-4648-8e53-053210d5b21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.237829 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda90b00-6da9-4648-8e53-053210d5b21f admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.252820 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1410/2828] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:24.253469 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0189ad-b098-4b29-9d50-97f92c21af26 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.281370 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0189ad-b098-4b29-9d50-97f92c21af26 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.287828 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf03ee-db4c-4f92-963b-4f6aedf33985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.287975 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf03ee-db4c-4f92-963b-4f6aedf33985 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.288188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf03ee-db4c-4f92-963b-4f6aedf33985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.288465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf03ee-db4c-4f92-963b-4f6aedf33985 admin admin] PATH_INFO: `/v3/projects/90ab12e64cea4b6094a6caa7e52a2196/users/00f2a158c82149e7afc40d71886e904f/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.308308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf03ee-db4c-4f92-963b-4f6aedf33985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ab12e64cea4b6094a6caa7e52a2196, user_id=00f2a158c82149e7afc40d71886e904f, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.311989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf03ee-db4c-4f92-963b-4f6aedf33985 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.315231 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:24.332571 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1419/2829] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:24 2022] PUT /identity/v3/projects/90ab12e64cea4b6094a6caa7e52a2196/users/00f2a158c82149e7afc40d71886e904f/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:24.344646 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a5103-ca87-451d-beb2-eb72c0ae4c17 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.344931 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a5103-ca87-451d-beb2-eb72c0ae4c17 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.345186 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a5103-ca87-451d-beb2-eb72c0ae4c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.381758 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-602a5103-ca87-451d-beb2-eb72c0ae4c17 None None] MFA Rules not processed for user `00f2a158c82149e7afc40d71886e904f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:24.383168 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-602a5103-ca87-451d-beb2-eb72c0ae4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:24.460351 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1411/2830] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:24.464632 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf03ee-db4c-4f92-963b-4f6aedf33985 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.535111 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf03ee-db4c-4f92-963b-4f6aedf33985 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.540009 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f8306-cc37-4bf4-a406-4130ab6b7495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.540736 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f8306-cc37-4bf4-a406-4130ab6b7495 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.541023 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f8306-cc37-4bf4-a406-4130ab6b7495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.541298 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f8306-cc37-4bf4-a406-4130ab6b7495 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.541927 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f8306-cc37-4bf4-a406-4130ab6b7495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.543854 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f8306-cc37-4bf4-a406-4130ab6b7495 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.577664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1420/2831] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:24 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:24.579154 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a5103-ca87-451d-beb2-eb72c0ae4c17 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.590410 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a5103-ca87-451d-beb2-eb72c0ae4c17 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.648215 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564303e-9c9e-48f5-a66d-2bbbaeb990ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.648825 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564303e-9c9e-48f5-a66d-2bbbaeb990ec admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.649107 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564303e-9c9e-48f5-a66d-2bbbaeb990ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.649402 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564303e-9c9e-48f5-a66d-2bbbaeb990ec admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.650019 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564303e-9c9e-48f5-a66d-2bbbaeb990ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.653179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564303e-9c9e-48f5-a66d-2bbbaeb990ec admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.680481 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1412/2832] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:24 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:24.681763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f8306-cc37-4bf4-a406-4130ab6b7495 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.692919 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f8306-cc37-4bf4-a406-4130ab6b7495 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.697881 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68973c-aa9b-44ac-8346-9f3833b8f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.698531 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68973c-aa9b-44ac-8346-9f3833b8f145 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.698877 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68973c-aa9b-44ac-8346-9f3833b8f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.699156 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68973c-aa9b-44ac-8346-9f3833b8f145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.699949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68973c-aa9b-44ac-8346-9f3833b8f145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.702426 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68973c-aa9b-44ac-8346-9f3833b8f145 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.713373 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1421/2833] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:24.718923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564303e-9c9e-48f5-a66d-2bbbaeb990ec admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.730111 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564303e-9c9e-48f5-a66d-2bbbaeb990ec admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.735018 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672bec9-9187-4c3d-b74a-bfb460a5ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.735653 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672bec9-9187-4c3d-b74a-bfb460a5ac07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.735933 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672bec9-9187-4c3d-b74a-bfb460a5ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.736247 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672bec9-9187-4c3d-b74a-bfb460a5ac07 admin admin] PATH_INFO: `/v3/projects/95fd6d3a69474b30b27c5224fd2fe88d/users/bee52e4660af45f2a80a37091e4d9271/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.739513 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:24.752503 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672bec9-9187-4c3d-b74a-bfb460a5ac07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95fd6d3a69474b30b27c5224fd2fe88d, user_id=bee52e4660af45f2a80a37091e4d9271, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.755157 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672bec9-9187-4c3d-b74a-bfb460a5ac07 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.768002 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1413/2834] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:24 2022] PUT /identity/v3/projects/95fd6d3a69474b30b27c5224fd2fe88d/users/bee52e4660af45f2a80a37091e4d9271/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 15:29:24.772163 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68973c-aa9b-44ac-8346-9f3833b8f145 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.782726 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68973c-aa9b-44ac-8346-9f3833b8f145 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.838040 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da8642-c105-4877-ad28-90664ee658a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.838755 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da8642-c105-4877-ad28-90664ee658a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.839034 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da8642-c105-4877-ad28-90664ee658a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.839342 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da8642-c105-4877-ad28-90664ee658a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.840064 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da8642-c105-4877-ad28-90664ee658a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.841679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da8642-c105-4877-ad28-90664ee658a7 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.852197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1422/2835] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:24.856351 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672bec9-9187-4c3d-b74a-bfb460a5ac07 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:24.866733 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672bec9-9187-4c3d-b74a-bfb460a5ac07 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:24.871220 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda4ab3-bf72-4f1d-b334-e6490bbc96ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:24.871854 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda4ab3-bf72-4f1d-b334-e6490bbc96ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.872131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda4ab3-bf72-4f1d-b334-e6490bbc96ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.872400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda4ab3-bf72-4f1d-b334-e6490bbc96ea admin admin] PATH_INFO: `/v3/projects/95fd6d3a69474b30b27c5224fd2fe88d/users/bee52e4660af45f2a80a37091e4d9271/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.874314 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda4ab3-bf72-4f1d-b334-e6490bbc96ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=95fd6d3a69474b30b27c5224fd2fe88d, user_id=bee52e4660af45f2a80a37091e4d9271, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:24.876919 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda4ab3-bf72-4f1d-b334-e6490bbc96ea admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:24.886761 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1414/2836] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:24 2022] PUT /identity/v3/projects/95fd6d3a69474b30b27c5224fd2fe88d/users/bee52e4660af45f2a80a37091e4d9271/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:24.897693 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b7318-d12a-4ffe-9509-2afac845d9a0 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:24.897983 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b7318-d12a-4ffe-9509-2afac845d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:24.898294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b7318-d12a-4ffe-9509-2afac845d9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:24.927095 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-530b7318-d12a-4ffe-9509-2afac845d9a0 None None] MFA Rules not processed for user `bee52e4660af45f2a80a37091e4d9271`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:24.928483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-530b7318-d12a-4ffe-9509-2afac845d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:24.978495 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:24.997322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1423/2837] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:25.009244 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda4ab3-bf72-4f1d-b334-e6490bbc96ea admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:25.010940 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8eda4ab3-bf72-4f1d-b334-e6490bbc96ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:25.067968 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda4ab3-bf72-4f1d-b334-e6490bbc96ea admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:25.071582 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b517d1-d4e2-42b0-ad9f-47f581bfd337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:25.072171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b517d1-d4e2-42b0-ad9f-47f581bfd337 service cinder] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:25.072444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b517d1-d4e2-42b0-ad9f-47f581bfd337 service cinder] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:25.072713 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b517d1-d4e2-42b0-ad9f-47f581bfd337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:25.081995 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b517d1-d4e2-42b0-ad9f-47f581bfd337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:25.083550 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b517d1-d4e2-42b0-ad9f-47f581bfd337 service cinder] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:25.092986 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1415/2838] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:25.166317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b7318-d12a-4ffe-9509-2afac845d9a0 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:25.176091 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b7318-d12a-4ffe-9509-2afac845d9a0 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:25.179743 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43611caa-4f99-46cb-a586-adc1b8b8e107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:25.180333 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43611caa-4f99-46cb-a586-adc1b8b8e107 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:25.180615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43611caa-4f99-46cb-a586-adc1b8b8e107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:25.180885 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43611caa-4f99-46cb-a586-adc1b8b8e107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:25.238197 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43611caa-4f99-46cb-a586-adc1b8b8e107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:25.239560 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43611caa-4f99-46cb-a586-adc1b8b8e107 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:25.248585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1424/2839] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:25.516050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b517d1-d4e2-42b0-ad9f-47f581bfd337 service cinder] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:25.581621 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b517d1-d4e2-42b0-ad9f-47f581bfd337 service cinder] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:25.586363 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:25.587061 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:25.587339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:25.587611 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] PATH_INFO: `/v3/users/00f2a158c82149e7afc40d71886e904f` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:25.588724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f2a158c82149e7afc40d71886e904f)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:25.590708 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:25.636599 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f2a158c82149e7afc40d71886e904f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:25.637278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f2a158c82149e7afc40d71886e904f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:25.637889 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f2a158c82149e7afc40d71886e904f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:25.644784 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f2a158c82149e7afc40d71886e904f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:25.651542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f2a158c82149e7afc40d71886e904f'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:25.661463 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:25.669650 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1416/2840] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:25 2022] DELETE /identity/v3/users/00f2a158c82149e7afc40d71886e904f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:25.674740 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b45d6-deae-49e5-9a7d-959abae13be9 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:25.675020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b45d6-deae-49e5-9a7d-959abae13be9 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:25.675396 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b45d6-deae-49e5-9a7d-959abae13be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:25.697554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-677b45d6-deae-49e5-9a7d-959abae13be9 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:25.698842 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-677b45d6-deae-49e5-9a7d-959abae13be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:25.758083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1425/2841] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:25.767892 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:25.769294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:25.826113 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea8f91-a9f1-4096-91fc-a4aee67cb538 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:25.829735 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e5366-ed25-465a-93ed-628b11799ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:25.830360 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e5366-ed25-465a-93ed-628b11799ead service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:25.830640 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e5366-ed25-465a-93ed-628b11799ead service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:25.830912 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e5366-ed25-465a-93ed-628b11799ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:25.841335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e5366-ed25-465a-93ed-628b11799ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:25.843328 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e5366-ed25-465a-93ed-628b11799ead service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:25.853243 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1417/2842] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:26.122778 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b45d6-deae-49e5-9a7d-959abae13be9 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:26.124246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-677b45d6-deae-49e5-9a7d-959abae13be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:26.137306 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b45d6-deae-49e5-9a7d-959abae13be9 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:26.145207 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:26.145972 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:26.146371 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:26.146650 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] PATH_INFO: `/v3/projects/90ab12e64cea4b6094a6caa7e52a2196` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:26.147789 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ab12e64cea4b6094a6caa7e52a2196)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:26.149710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:26.196381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ab12e64cea4b6094a6caa7e52a2196', 'request_id': 'req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.202448 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ab12e64cea4b6094a6caa7e52a2196', 'request_id': 'req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.209895 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ab12e64cea4b6094a6caa7e52a2196', 'request_id': 'req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.222388 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] The token cache is being invalidate because project 90ab12e64cea4b6094a6caa7e52a2196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:26.222678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.223308 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.224780 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1426/2843] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:26 2022] DELETE /identity/v3/projects/90ab12e64cea4b6094a6caa7e52a2196 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:26.228742 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e5366-ed25-465a-93ed-628b11799ead service neutron] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:26.238597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e5366-ed25-465a-93ed-628b11799ead service neutron] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:26.294468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54190d82-7593-467f-af86-fd2282239528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:26.295026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190d82-7593-467f-af86-fd2282239528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:26.295308 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190d82-7593-467f-af86-fd2282239528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:26.295583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54190d82-7593-467f-af86-fd2282239528 admin admin] PATH_INFO: `/v3/users/bee52e4660af45f2a80a37091e4d9271` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:26.296724 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54190d82-7593-467f-af86-fd2282239528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee52e4660af45f2a80a37091e4d9271)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:26.298683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54190d82-7593-467f-af86-fd2282239528 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:26.344531 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-54190d82-7593-467f-af86-fd2282239528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee52e4660af45f2a80a37091e4d9271'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.345205 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-54190d82-7593-467f-af86-fd2282239528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee52e4660af45f2a80a37091e4d9271'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.345805 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-54190d82-7593-467f-af86-fd2282239528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee52e4660af45f2a80a37091e4d9271'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.353284 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-54190d82-7593-467f-af86-fd2282239528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee52e4660af45f2a80a37091e4d9271'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.360278 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-54190d82-7593-467f-af86-fd2282239528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee52e4660af45f2a80a37091e4d9271'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.377437 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1418/2844] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:26 2022] DELETE /identity/v3/users/bee52e4660af45f2a80a37091e4d9271 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:26.644781 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:26.646368 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:26.660447 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a81a4-b914-4a41-be1a-239a0edd5fbb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:26.669970 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:26.725951 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:26.726978 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:26.727331 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:26.727658 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] PATH_INFO: `/v3/projects/95fd6d3a69474b30b27c5224fd2fe88d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:26.728807 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95fd6d3a69474b30b27c5224fd2fe88d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:26.730924 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:26.780636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95fd6d3a69474b30b27c5224fd2fe88d', 'request_id': 'req-06547b37-88d8-4b21-a2df-a2a2a67ce716'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.785937 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95fd6d3a69474b30b27c5224fd2fe88d', 'request_id': 'req-06547b37-88d8-4b21-a2df-a2a2a67ce716'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.792952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95fd6d3a69474b30b27c5224fd2fe88d', 'request_id': 'req-06547b37-88d8-4b21-a2df-a2a2a67ce716'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.804133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] The token cache is being invalidate because project 95fd6d3a69474b30b27c5224fd2fe88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:26.804417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.805038 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-06547b37-88d8-4b21-a2df-a2a2a67ce716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:26.806607 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1427/2845] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:26 2022] DELETE /identity/v3/projects/95fd6d3a69474b30b27c5224fd2fe88d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:26.812882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448f6e8-03a7-4b80-a84a-34f8f6f3bec2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:26.813168 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448f6e8-03a7-4b80-a84a-34f8f6f3bec2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:26.813444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448f6e8-03a7-4b80-a84a-34f8f6f3bec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:26.834201 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-9448f6e8-03a7-4b80-a84a-34f8f6f3bec2 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:26.835563 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-9448f6e8-03a7-4b80-a84a-34f8f6f3bec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:26.846573 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:26.900054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1419/2846] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:26.909420 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d18e0a-a5d1-4d86-aa0c-f62c87fb8b42 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:26.909706 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d18e0a-a5d1-4d86-aa0c-f62c87fb8b42 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:26.909995 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d18e0a-a5d1-4d86-aa0c-f62c87fb8b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:26.931741 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-f7d18e0a-a5d1-4d86-aa0c-f62c87fb8b42 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:26.932954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f7d18e0a-a5d1-4d86-aa0c-f62c87fb8b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:26.941788 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1428/2847] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:26.945795 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448f6e8-03a7-4b80-a84a-34f8f6f3bec2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:26.956374 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448f6e8-03a7-4b80-a84a-34f8f6f3bec2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:26.961137 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1a7d4-2ff4-439a-a5ee-d45873d9eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:26.961863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1a7d4-2ff4-439a-a5ee-d45873d9eecd admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:26.962187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1a7d4-2ff4-439a-a5ee-d45873d9eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:26.962462 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1a7d4-2ff4-439a-a5ee-d45873d9eecd admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:26.963142 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1a7d4-2ff4-439a-a5ee-d45873d9eecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:29:26.963443 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1a7d4-2ff4-439a-a5ee-d45873d9eecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:26.965037 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1a7d4-2ff4-439a-a5ee-d45873d9eecd admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:26.980465 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1420/2848] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:29:26.981630 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d18e0a-a5d1-4d86-aa0c-f62c87fb8b42 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:26.991452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d18e0a-a5d1-4d86-aa0c-f62c87fb8b42 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:26.996316 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018564a3-6479-4dee-ac13-0603d467e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:26.996920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018564a3-6479-4dee-ac13-0603d467e774 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:26.997211 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018564a3-6479-4dee-ac13-0603d467e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:26.997478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018564a3-6479-4dee-ac13-0603d467e774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:26.998144 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018564a3-6479-4dee-ac13-0603d467e774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:27.000674 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018564a3-6479-4dee-ac13-0603d467e774 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:27.030090 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1429/2849] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:26 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:27.034248 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1a7d4-2ff4-439a-a5ee-d45873d9eecd admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:27.044780 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1a7d4-2ff4-439a-a5ee-d45873d9eecd admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:27.103655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dee02-66d7-4cbc-be50-22d7bf83ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:27.104263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dee02-66d7-4cbc-be50-22d7bf83ae7b admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:27.104542 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dee02-66d7-4cbc-be50-22d7bf83ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:27.104814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2dee02-66d7-4cbc-be50-22d7bf83ae7b admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:27.105427 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2dee02-66d7-4cbc-be50-22d7bf83ae7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:27.107350 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2dee02-66d7-4cbc-be50-22d7bf83ae7b admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:27.128622 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1421/2850] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:27 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:27.132769 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018564a3-6479-4dee-ac13-0603d467e774 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:27.142908 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018564a3-6479-4dee-ac13-0603d467e774 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:27.147496 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eba35-da2e-41a2-84a9-c4eb0041384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:27.148084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eba35-da2e-41a2-84a9-c4eb0041384a admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:27.148361 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eba35-da2e-41a2-84a9-c4eb0041384a admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:27.148629 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eba35-da2e-41a2-84a9-c4eb0041384a admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:27.149261 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eba35-da2e-41a2-84a9-c4eb0041384a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:27.150898 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eba35-da2e-41a2-84a9-c4eb0041384a admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:27.160949 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1430/2851] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:27.164655 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dee02-66d7-4cbc-be50-22d7bf83ae7b admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:27.175182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2dee02-66d7-4cbc-be50-22d7bf83ae7b admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:27.179910 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2a128-fa69-4612-8589-a9e843ca21e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:27.180441 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2a128-fa69-4612-8589-a9e843ca21e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:27.180723 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2a128-fa69-4612-8589-a9e843ca21e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:27.180998 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2a128-fa69-4612-8589-a9e843ca21e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:27.181672 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2a128-fa69-4612-8589-a9e843ca21e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:27.183335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2a128-fa69-4612-8589-a9e843ca21e3 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:27.194300 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1422/2852] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:27.198097 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eba35-da2e-41a2-84a9-c4eb0041384a admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:27.208173 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eba35-da2e-41a2-84a9-c4eb0041384a admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:27.212867 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01827a30-0be9-4045-bb69-19594c434f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:27.213510 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01827a30-0be9-4045-bb69-19594c434f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:27.214093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01827a30-0be9-4045-bb69-19594c434f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:27.214093 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01827a30-0be9-4045-bb69-19594c434f27 admin admin] PATH_INFO: `/v3/projects/bf01e13df08f438dab56c232d3d5ccfc/users/059982e1b19c4a8493c2804bf2cd9497/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:27.229446 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01827a30-0be9-4045-bb69-19594c434f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf01e13df08f438dab56c232d3d5ccfc, user_id=059982e1b19c4a8493c2804bf2cd9497, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:27.232139 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01827a30-0be9-4045-bb69-19594c434f27 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:27.244981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1431/2853] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:27 2022] PUT /identity/v3/projects/bf01e13df08f438dab56c232d3d5ccfc/users/059982e1b19c4a8493c2804bf2cd9497/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:27.255700 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4d7e6-323c-45ee-a6e7-8507cb4678a0 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:27.256179 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4d7e6-323c-45ee-a6e7-8507cb4678a0 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:27.256272 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4d7e6-323c-45ee-a6e7-8507cb4678a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:27.283354 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-75e4d7e6-323c-45ee-a6e7-8507cb4678a0 None None] MFA Rules not processed for user `059982e1b19c4a8493c2804bf2cd9497`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:27.284565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-75e4d7e6-323c-45ee-a6e7-8507cb4678a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:27.348206 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1423/2854] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:27.359415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01827a30-0be9-4045-bb69-19594c434f27 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:27.361273 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-01827a30-0be9-4045-bb69-19594c434f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:27.403058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:27.421155 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01827a30-0be9-4045-bb69-19594c434f27 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:27.424829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493405d0-11c9-48ab-a4f9-69869345f0f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895028dd70a0415595a0ff8ebedb1f0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:27.425439 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493405d0-11c9-48ab-a4f9-69869345f0f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:27.425731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493405d0-11c9-48ab-a4f9-69869345f0f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:27.425999 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493405d0-11c9-48ab-a4f9-69869345f0f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:27.434611 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493405d0-11c9-48ab-a4f9-69869345f0f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:27.436046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493405d0-11c9-48ab-a4f9-69869345f0f4 service cinder] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:27.446237 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1432/2855] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:30.008535 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4d7e6-323c-45ee-a6e7-8507cb4678a0 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:30.020858 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:30.071400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4d7e6-323c-45ee-a6e7-8507cb4678a0 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:30.075866 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:30.076483 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:30.076757 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:30.077026 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] PATH_INFO: `/v3/users/059982e1b19c4a8493c2804bf2cd9497` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:30.078149 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=059982e1b19c4a8493c2804bf2cd9497)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:30.080050 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:30.127359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059982e1b19c4a8493c2804bf2cd9497'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:30.128016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059982e1b19c4a8493c2804bf2cd9497'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:30.128625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059982e1b19c4a8493c2804bf2cd9497'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:30.136435 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059982e1b19c4a8493c2804bf2cd9497'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:30.144159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059982e1b19c4a8493c2804bf2cd9497'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:30.161786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1424/2856] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:30 2022] DELETE /identity/v3/users/059982e1b19c4a8493c2804bf2cd9497 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:30.166228 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e727349-b601-4d0c-8e4d-abbb183de15f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:30.166703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e727349-b601-4d0c-8e4d-abbb183de15f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:30.166920 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e727349-b601-4d0c-8e4d-abbb183de15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:30.187047 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-8e727349-b601-4d0c-8e4d-abbb183de15f None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:30.188272 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e727349-b601-4d0c-8e4d-abbb183de15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:30.249829 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1433/2857] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:30.259591 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:30.261010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:30.318880 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e246a-5450-4547-ad4f-e68329df7dba admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:30.322485 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a1218-0d92-40a6-b23f-255852b57711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:30.323083 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1218-0d92-40a6-b23f-255852b57711 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:30.323358 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1218-0d92-40a6-b23f-255852b57711 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:30.323629 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a1218-0d92-40a6-b23f-255852b57711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:30.333223 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a1218-0d92-40a6-b23f-255852b57711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:30.334671 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a1218-0d92-40a6-b23f-255852b57711 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:30.344114 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1425/2858] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:30.611513 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e727349-b601-4d0c-8e4d-abbb183de15f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:30.613069 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-8e727349-b601-4d0c-8e4d-abbb183de15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:30.627318 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e727349-b601-4d0c-8e4d-abbb183de15f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:30.632480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:30.633131 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:30.633597 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:30.633878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] PATH_INFO: `/v3/projects/bf01e13df08f438dab56c232d3d5ccfc` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:30.635061 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf01e13df08f438dab56c232d3d5ccfc)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:30.636981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:30.682246 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf01e13df08f438dab56c232d3d5ccfc', 'request_id': 'req-5afebe63-5d27-401a-b7e9-4ca57677a522'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:30.688013 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf01e13df08f438dab56c232d3d5ccfc', 'request_id': 'req-5afebe63-5d27-401a-b7e9-4ca57677a522'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:30.695151 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf01e13df08f438dab56c232d3d5ccfc', 'request_id': 'req-5afebe63-5d27-401a-b7e9-4ca57677a522'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:30.706154 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] The token cache is being invalidate because project bf01e13df08f438dab56c232d3d5ccfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81449) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:30.706445 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:30.707084 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-5afebe63-5d27-401a-b7e9-4ca57677a522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:30.708578 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1434/2859] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:30 2022] DELETE /identity/v3/projects/bf01e13df08f438dab56c232d3d5ccfc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:30.714645 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d539c-3d45-42b9-ad82-bfe887dccb49 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:30.714932 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d539c-3d45-42b9-ad82-bfe887dccb49 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:30.715210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d539c-3d45-42b9-ad82-bfe887dccb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:30.734799 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-901d539c-3d45-42b9-ad82-bfe887dccb49 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:30.736006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-901d539c-3d45-42b9-ad82-bfe887dccb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:30.766185 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:30.797476 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1426/2860] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:30.805504 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02be29-a97e-409f-94c6-178e58b986aa None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:30.805791 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02be29-a97e-409f-94c6-178e58b986aa None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:30.806099 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02be29-a97e-409f-94c6-178e58b986aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:30.826985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-ea02be29-a97e-409f-94c6-178e58b986aa None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:30.828493 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ea02be29-a97e-409f-94c6-178e58b986aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:30.837400 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1435/2861] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:30.842210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d539c-3d45-42b9-ad82-bfe887dccb49 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:30.852470 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d539c-3d45-42b9-ad82-bfe887dccb49 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:30.857203 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ae206-fa8b-4066-a2ed-201678e9bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:30.857803 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ae206-fa8b-4066-a2ed-201678e9bcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:30.858661 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ae206-fa8b-4066-a2ed-201678e9bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:30.858934 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ae206-fa8b-4066-a2ed-201678e9bcf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:30.859577 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ae206-fa8b-4066-a2ed-201678e9bcf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81450) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 15:29:30.859882 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ae206-fa8b-4066-a2ed-201678e9bcf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:30.861468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ae206-fa8b-4066-a2ed-201678e9bcf9 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:30.873062 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1427/2862] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Aug 19 15:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 15:29:30.878045 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02be29-a97e-409f-94c6-178e58b986aa None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:30.887678 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02be29-a97e-409f-94c6-178e58b986aa None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:30.892837 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006130c-a9bc-4eab-b5d1-03843648471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:30.893423 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006130c-a9bc-4eab-b5d1-03843648471e admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:30.893703 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006130c-a9bc-4eab-b5d1-03843648471e admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:30.893981 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006130c-a9bc-4eab-b5d1-03843648471e admin admin] PATH_INFO: `/v3/projects` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:30.894649 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006130c-a9bc-4eab-b5d1-03843648471e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:30.896752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006130c-a9bc-4eab-b5d1-03843648471e admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:30.924581 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1436/2863] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:30 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:30.928823 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ae206-fa8b-4066-a2ed-201678e9bcf9 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:30.940251 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ae206-fa8b-4066-a2ed-201678e9bcf9 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:31.000983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d0fbf-c6a2-4332-b422-0e6ece727634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:31.001588 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0fbf-c6a2-4332-b422-0e6ece727634 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:31.001870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0fbf-c6a2-4332-b422-0e6ece727634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:31.002181 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0fbf-c6a2-4332-b422-0e6ece727634 admin admin] PATH_INFO: `/v3/users` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:31.002807 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d0fbf-c6a2-4332-b422-0e6ece727634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:31.005087 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d0fbf-c6a2-4332-b422-0e6ece727634 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:31.029585 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1428/2864] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:30 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:31.030806 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006130c-a9bc-4eab-b5d1-03843648471e admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:31.043414 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006130c-a9bc-4eab-b5d1-03843648471e admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:31.048136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca304c7e-328c-462b-b139-28f326990f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:31.048739 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca304c7e-328c-462b-b139-28f326990f2d admin admin] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:31.049018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca304c7e-328c-462b-b139-28f326990f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:31.049294 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca304c7e-328c-462b-b139-28f326990f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:31.049935 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca304c7e-328c-462b-b139-28f326990f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:31.051562 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca304c7e-328c-462b-b139-28f326990f2d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:31.061985 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1437/2865] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 15:29:31.066006 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d0fbf-c6a2-4332-b422-0e6ece727634 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:31.076072 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d0fbf-c6a2-4332-b422-0e6ece727634 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:31.081246 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f255d-31f2-4236-b217-8592e467af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:31.081826 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f255d-31f2-4236-b217-8592e467af85 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:31.082150 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f255d-31f2-4236-b217-8592e467af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:31.082428 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f255d-31f2-4236-b217-8592e467af85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:31.083097 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f255d-31f2-4236-b217-8592e467af85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:31.084683 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f255d-31f2-4236-b217-8592e467af85 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:31.096516 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1429/2866] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:31.100579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca304c7e-328c-462b-b139-28f326990f2d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:31.110408 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca304c7e-328c-462b-b139-28f326990f2d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:31.115278 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2559e1-3054-4f15-b950-7bcb88cb62d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:31.115964 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2559e1-3054-4f15-b950-7bcb88cb62d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:31.116245 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2559e1-3054-4f15-b950-7bcb88cb62d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:31.116515 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2559e1-3054-4f15-b950-7bcb88cb62d1 admin admin] PATH_INFO: `/v3/projects/56262b33989d4c3ba1c8811118bab9c8/users/8c3666d4c24143a8b3f064ccfb38cad6/roles/e4dc6d4cfce94e67aa327307e8bd4190` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:31.131644 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2559e1-3054-4f15-b950-7bcb88cb62d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56262b33989d4c3ba1c8811118bab9c8, user_id=8c3666d4c24143a8b3f064ccfb38cad6, role_id=e4dc6d4cfce94e67aa327307e8bd4190)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:31.134378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2559e1-3054-4f15-b950-7bcb88cb62d1 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:31.143281 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:31.148459 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1438/2867] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:31 2022] PUT /identity/v3/projects/56262b33989d4c3ba1c8811118bab9c8/users/8c3666d4c24143a8b3f064ccfb38cad6/roles/e4dc6d4cfce94e67aa327307e8bd4190 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:31.153699 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1d3e-9c13-408b-9054-7171ba872dbb None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:31.153984 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1d3e-9c13-408b-9054-7171ba872dbb None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:31.154282 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1d3e-9c13-408b-9054-7171ba872dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:31.173317 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-004f1d3e-9c13-408b-9054-7171ba872dbb None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:31.174560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-004f1d3e-9c13-408b-9054-7171ba872dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:31.233265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1430/2868] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:31.242692 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2559e1-3054-4f15-b950-7bcb88cb62d1 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:31.244474 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-7b2559e1-3054-4f15-b950-7bcb88cb62d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:31.302317 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2559e1-3054-4f15-b950-7bcb88cb62d1 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:31.306133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aaa60-33e5-40a3-aadb-2ebc47cbbe0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:31.306771 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aaa60-33e5-40a3-aadb-2ebc47cbbe0f service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:31.307046 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aaa60-33e5-40a3-aadb-2ebc47cbbe0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:31.307312 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aaa60-33e5-40a3-aadb-2ebc47cbbe0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:31.317478 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670aaa60-33e5-40a3-aadb-2ebc47cbbe0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:31.318934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670aaa60-33e5-40a3-aadb-2ebc47cbbe0f service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:31.328454 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1439/2869] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:35.519922 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6098ef-6a66-4fb1-9e8a-7bb96f0f15ec None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:35.520760 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6098ef-6a66-4fb1-9e8a-7bb96f0f15ec None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:35.521211 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6098ef-6a66-4fb1-9e8a-7bb96f0f15ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:35.560847 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8d6098ef-6a66-4fb1-9e8a-7bb96f0f15ec None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:35.562171 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8d6098ef-6a66-4fb1-9e8a-7bb96f0f15ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:35.610089 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:35.639097 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1431/2870] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:35.723742 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aaa60-33e5-40a3-aadb-2ebc47cbbe0f service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:35.726068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-670aaa60-33e5-40a3-aadb-2ebc47cbbe0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:35.743444 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9806-d292-4439-8177-01a8a9bd491b None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:35.743985 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9806-d292-4439-8177-01a8a9bd491b None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:35.744456 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9806-d292-4439-8177-01a8a9bd491b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:35.816420 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-8c6c9806-d292-4439-8177-01a8a9bd491b None None] MFA Rules not processed for user `8c3666d4c24143a8b3f064ccfb38cad6`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:35.817767 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-8c6c9806-d292-4439-8177-01a8a9bd491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:35.866485 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aaa60-33e5-40a3-aadb-2ebc47cbbe0f service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:35.872592 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f68848-caca-491e-ad06-4a92d175785c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:35.874128 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68848-caca-491e-ad06-4a92d175785c service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:35.874670 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68848-caca-491e-ad06-4a92d175785c service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:35.875186 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f68848-caca-491e-ad06-4a92d175785c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:35.885271 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f68848-caca-491e-ad06-4a92d175785c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:35.886915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f68848-caca-491e-ad06-4a92d175785c service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:35.898744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1432/2871] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:35.903121 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c9806-d292-4439-8177-01a8a9bd491b None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:35.915178 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1440/2872] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:29:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:29:35.919558 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c9806-d292-4439-8177-01a8a9bd491b None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:35.925196 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08353001-7e64-4a43-a787-d4979d079672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:35.925820 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08353001-7e64-4a43-a787-d4979d079672 admin admin] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:35.926274 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08353001-7e64-4a43-a787-d4979d079672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:35.926551 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08353001-7e64-4a43-a787-d4979d079672 admin admin] PATH_INFO: `/v3/projects` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:35.927187 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08353001-7e64-4a43-a787-d4979d079672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:35.929836 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08353001-7e64-4a43-a787-d4979d079672 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:35.979182 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1433/2873] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Aug 19 15:29:35 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:35.983188 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f68848-caca-491e-ad06-4a92d175785c service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:35.994934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f68848-caca-491e-ad06-4a92d175785c service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:36.089114 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8415b-f7d1-405a-acff-a793778d9ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:36.090592 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8415b-f7d1-405a-acff-a793778d9ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:36.091136 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8415b-f7d1-405a-acff-a793778d9ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:36.091410 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8415b-f7d1-405a-acff-a793778d9ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:36.092991 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8415b-f7d1-405a-acff-a793778d9ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:36.095066 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8415b-f7d1-405a-acff-a793778d9ec9 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:36.128554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1441/2874] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Aug 19 15:29:35 2022] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 15:29:36.132627 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08353001-7e64-4a43-a787-d4979d079672 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:36.147135 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08353001-7e64-4a43-a787-d4979d079672 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:36.153665 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005b8b9-4e3d-4f6b-b31f-d67a72b1e055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:36.154603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b8b9-4e3d-4f6b-b31f-d67a72b1e055 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:36.155678 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b8b9-4e3d-4f6b-b31f-d67a72b1e055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:36.156152 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b8b9-4e3d-4f6b-b31f-d67a72b1e055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:36.157023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005b8b9-4e3d-4f6b-b31f-d67a72b1e055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:36.158865 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005b8b9-4e3d-4f6b-b31f-d67a72b1e055 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:36.174191 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1434/2875] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:36.177012 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8415b-f7d1-405a-acff-a793778d9ec9 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:36.188530 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8415b-f7d1-405a-acff-a793778d9ec9 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:36.198636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084d4e3-be75-4d5c-8161-415691d8aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:36.198636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d4e3-be75-4d5c-8161-415691d8aa65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:36.198636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d4e3-be75-4d5c-8161-415691d8aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:36.198636 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d4e3-be75-4d5c-8161-415691d8aa65 admin admin] PATH_INFO: `/v3/projects/8c73faf0859f48f695cd75d8ca0e83bc/users/44a5836d91a54722b86d88f4a79ca60f/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:36.218194 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084d4e3-be75-4d5c-8161-415691d8aa65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c73faf0859f48f695cd75d8ca0e83bc, user_id=44a5836d91a54722b86d88f4a79ca60f, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:36.221409 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084d4e3-be75-4d5c-8161-415691d8aa65 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:36.236763 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:36.246483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1442/2876] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:36 2022] PUT /identity/v3/projects/8c73faf0859f48f695cd75d8ca0e83bc/users/44a5836d91a54722b86d88f4a79ca60f/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:36.250888 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005b8b9-4e3d-4f6b-b31f-d67a72b1e055 admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:36.264822 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005b8b9-4e3d-4f6b-b31f-d67a72b1e055 admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:36.333292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84ac3c-3118-4122-94b7-a7eaed855f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:36.333971 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84ac3c-3118-4122-94b7-a7eaed855f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:36.334359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84ac3c-3118-4122-94b7-a7eaed855f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:36.334692 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84ac3c-3118-4122-94b7-a7eaed855f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:36.335398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84ac3c-3118-4122-94b7-a7eaed855f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:36.337031 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84ac3c-3118-4122-94b7-a7eaed855f16 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:36.348605 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1435/2877] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Aug 19 15:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 15:29:36.352686 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084d4e3-be75-4d5c-8161-415691d8aa65 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:36.364921 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084d4e3-be75-4d5c-8161-415691d8aa65 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:36.369149 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23bec9-e0b1-4f80-a48a-66121eee7afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:36.369796 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23bec9-e0b1-4f80-a48a-66121eee7afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:36.370133 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23bec9-e0b1-4f80-a48a-66121eee7afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:36.370411 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23bec9-e0b1-4f80-a48a-66121eee7afe admin admin] PATH_INFO: `/v3/projects/8c73faf0859f48f695cd75d8ca0e83bc/users/44a5836d91a54722b86d88f4a79ca60f/roles/6247536207ef4c36bdee0e4606d6d73d` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:36.372535 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23bec9-e0b1-4f80-a48a-66121eee7afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c73faf0859f48f695cd75d8ca0e83bc, user_id=44a5836d91a54722b86d88f4a79ca60f, role_id=6247536207ef4c36bdee0e4606d6d73d)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:36.375232 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23bec9-e0b1-4f80-a48a-66121eee7afe admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:36.386455 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1443/2878] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Aug 19 15:29:36 2022] PUT /identity/v3/projects/8c73faf0859f48f695cd75d8ca0e83bc/users/44a5836d91a54722b86d88f4a79ca60f/roles/6247536207ef4c36bdee0e4606d6d73d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:36.519294 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09485d21-76e5-4bca-91b5-dcd6320bef7d None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:36.519676 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09485d21-76e5-4bca-91b5-dcd6320bef7d None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:36.519961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09485d21-76e5-4bca-91b5-dcd6320bef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:36.542085 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-09485d21-76e5-4bca-91b5-dcd6320bef7d None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:36.543625 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-09485d21-76e5-4bca-91b5-dcd6320bef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:36.587353 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:36.614726 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1436/2879] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 19 15:29:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:36.627730 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23bec9-e0b1-4f80-a48a-66121eee7afe admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:36.735399 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23bec9-e0b1-4f80-a48a-66121eee7afe admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:36.742583 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023ee4b-7f3e-40f0-b574-6d97e2801fce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:36.743210 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023ee4b-7f3e-40f0-b574-6d97e2801fce service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:36.743489 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023ee4b-7f3e-40f0-b574-6d97e2801fce service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:36.743761 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023ee4b-7f3e-40f0-b574-6d97e2801fce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:36.753777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023ee4b-7f3e-40f0-b574-6d97e2801fce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:36.755418 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023ee4b-7f3e-40f0-b574-6d97e2801fce service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:36.765266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1444/2880] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:29:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:29:37.020335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f18778-5c52-46a4-93fc-5fa3441dd76a None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:37.020635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f18778-5c52-46a4-93fc-5fa3441dd76a None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:37.020918 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f18778-5c52-46a4-93fc-5fa3441dd76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:37.047916 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-c7f18778-5c52-46a4-93fc-5fa3441dd76a None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:37.050180 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-c7f18778-5c52-46a4-93fc-5fa3441dd76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:37.060565 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1437/2881] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:37.079200 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023ee4b-7f3e-40f0-b574-6d97e2801fce service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:37.090864 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023ee4b-7f3e-40f0-b574-6d97e2801fce service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:37.096711 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86ad14-2a80-4fba-be28-e0a297da3922 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:37.097274 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86ad14-2a80-4fba-be28-e0a297da3922 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:37.097554 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86ad14-2a80-4fba-be28-e0a297da3922 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:37.097817 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86ad14-2a80-4fba-be28-e0a297da3922 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:37.109048 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86ad14-2a80-4fba-be28-e0a297da3922 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:37.111027 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86ad14-2a80-4fba-be28-e0a297da3922 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:37.120785 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1445/2882] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:29:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:29:37.531223 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460b02-f285-45fd-bb16-6b7afa0707f2 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:37.532080 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460b02-f285-45fd-bb16-6b7afa0707f2 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:37.532499 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460b02-f285-45fd-bb16-6b7afa0707f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:37.555732 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-49460b02-f285-45fd-bb16-6b7afa0707f2 None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:37.557515 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-49460b02-f285-45fd-bb16-6b7afa0707f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:37.567193 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1438/2883] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 19 15:29:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:37.582656 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86ad14-2a80-4fba-be28-e0a297da3922 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:37.595004 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86ad14-2a80-4fba-be28-e0a297da3922 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:37.601068 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e044cb-1474-47b7-a6ea-5ea39f657341 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:37.601790 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e044cb-1474-47b7-a6ea-5ea39f657341 service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:37.602359 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e044cb-1474-47b7-a6ea-5ea39f657341 service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:37.602702 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e044cb-1474-47b7-a6ea-5ea39f657341 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:37.613566 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e044cb-1474-47b7-a6ea-5ea39f657341 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:37.616440 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e044cb-1474-47b7-a6ea-5ea39f657341 service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:37.640615 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1446/2884] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:29:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:29:39.665217 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460b02-f285-45fd-bb16-6b7afa0707f2 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:39.791134 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460b02-f285-45fd-bb16-6b7afa0707f2 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:39.799400 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab209ab-bd28-4e2d-aa11-1799448d57e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:39.800292 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab209ab-bd28-4e2d-aa11-1799448d57e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:39.800755 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab209ab-bd28-4e2d-aa11-1799448d57e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:39.801262 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab209ab-bd28-4e2d-aa11-1799448d57e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:39.804612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ab209ab-bd28-4e2d-aa11-1799448d57e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:39.940467 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab209ab-bd28-4e2d-aa11-1799448d57e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:39.942285 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab209ab-bd28-4e2d-aa11-1799448d57e6 service neutron] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:39.964027 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1439/2885] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:40.031102 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e044cb-1474-47b7-a6ea-5ea39f657341 service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:40.032585 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-17e044cb-1474-47b7-a6ea-5ea39f657341 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:40.209433 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e044cb-1474-47b7-a6ea-5ea39f657341 service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:40.223786 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:40.224705 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:40.225152 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:40.225591 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] PATH_INFO: `/v3/users/631e841c2d80406184e7358788a4023a` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:40.229050 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] RBAC: Authorizing `identity:delete_user(user_id=631e841c2d80406184e7358788a4023a)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:40.234718 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:40.342863 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '631e841c2d80406184e7358788a4023a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:40.345766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:40.355984 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '631e841c2d80406184e7358788a4023a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:40.388679 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '631e841c2d80406184e7358788a4023a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:40.406720 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '631e841c2d80406184e7358788a4023a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:40.407746 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '631e841c2d80406184e7358788a4023a'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:40.417689 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1447/2886] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:40 2022] DELETE /identity/v3/users/631e841c2d80406184e7358788a4023a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:40.419165 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772be620-a9f6-46dc-94da-166af78fca63 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:40.419455 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772be620-a9f6-46dc-94da-166af78fca63 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:40.419734 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772be620-a9f6-46dc-94da-166af78fca63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:40.462981 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-772be620-a9f6-46dc-94da-166af78fca63 None None] MFA Rules not processed for user `9828bdee3ea64cec99e58fcb117e4cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:40.464597 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-772be620-a9f6-46dc-94da-166af78fca63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:40.622751 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1440/2887] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:40.640378 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:40.642227 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:40.805394 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39684f02-57f8-4ade-b5dd-552bd2ea332d admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:40.813222 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9239cdc-2743-495b-a61f-441451997d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:40.813952 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239cdc-2743-495b-a61f-441451997d04 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:40.814192 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239cdc-2743-495b-a61f-441451997d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:40.814468 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239cdc-2743-495b-a61f-441451997d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:40.834980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9239cdc-2743-495b-a61f-441451997d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:40.836415 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9239cdc-2743-495b-a61f-441451997d04 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:40.867096 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1448/2888] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:41.385716 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772be620-a9f6-46dc-94da-166af78fca63 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:41.390132 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-772be620-a9f6-46dc-94da-166af78fca63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:41.415812 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772be620-a9f6-46dc-94da-166af78fca63 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:41.426631 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:41.427301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:41.427580 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:41.428054 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] PATH_INFO: `/v3/projects/2113ca9fa22043e3a91758df2e91ace6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:41.429461 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2113ca9fa22043e3a91758df2e91ace6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:41.432681 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:41.477786 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=100 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:41.532893 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9239cdc-2743-495b-a61f-441451997d04 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:41.534322 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f9239cdc-2743-495b-a61f-441451997d04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:41.535016 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2113ca9fa22043e3a91758df2e91ace6', 'request_id': 'req-b6775413-07bb-4a26-9f08-66da6c192931'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:41.541958 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2113ca9fa22043e3a91758df2e91ace6', 'request_id': 'req-b6775413-07bb-4a26-9f08-66da6c192931'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:41.562350 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2113ca9fa22043e3a91758df2e91ace6', 'request_id': 'req-b6775413-07bb-4a26-9f08-66da6c192931'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:41.595414 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] The token cache is being invalidate because project 2113ca9fa22043e3a91758df2e91ace6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:41.596856 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:41.597612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-b6775413-07bb-4a26-9f08-66da6c192931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:41.599612 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1441/2889] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:41 2022] DELETE /identity/v3/projects/2113ca9fa22043e3a91758df2e91ace6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:41.684432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec054f0-86b4-4fa8-a8e2-7e36647931a3 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:41.684931 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec054f0-86b4-4fa8-a8e2-7e36647931a3 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:41.685532 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec054f0-86b4-4fa8-a8e2-7e36647931a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:41.778741 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-0ec054f0-86b4-4fa8-a8e2-7e36647931a3 None None] MFA Rules not processed for user `44a5836d91a54722b86d88f4a79ca60f`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:41.780131 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ec054f0-86b4-4fa8-a8e2-7e36647931a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:41.818820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9239cdc-2743-495b-a61f-441451997d04 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:41.952870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea200ce0-31d8-4c6e-8629-6a87bb7bde1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ca59cbf894c508b3439b08715da86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:41.953804 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea200ce0-31d8-4c6e-8629-6a87bb7bde1f service nova] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:41.954125 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea200ce0-31d8-4c6e-8629-6a87bb7bde1f service nova] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:41.954483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea200ce0-31d8-4c6e-8629-6a87bb7bde1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:41.956310 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-ea200ce0-31d8-4c6e-8629-6a87bb7bde1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:41.966417 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:41.974777 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea200ce0-31d8-4c6e-8629-6a87bb7bde1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:41.977235 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea200ce0-31d8-4c6e-8629-6a87bb7bde1f service nova] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:41.987136 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1442/2890] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:41.990945 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1449/2891] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:29:41.997692 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec054f0-86b4-4fa8-a8e2-7e36647931a3 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:41.999851 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-0ec054f0-86b4-4fa8-a8e2-7e36647931a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:42.086814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec054f0-86b4-4fa8-a8e2-7e36647931a3 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:42.091386 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8a1be-7eaf-445a-8c71-478261cfaedd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c23bb3a6586247e0a11ece33569d6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:42.092197 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8a1be-7eaf-445a-8c71-478261cfaedd service glance] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:42.092937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8a1be-7eaf-445a-8c71-478261cfaedd service glance] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:42.092937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8a1be-7eaf-445a-8c71-478261cfaedd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:42.094693 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f6c8a1be-7eaf-445a-8c71-478261cfaedd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:42.149783 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:42.168022 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8a1be-7eaf-445a-8c71-478261cfaedd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:42.169870 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8a1be-7eaf-445a-8c71-478261cfaedd service glance] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:42.181839 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1443/2892] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 15:29:42.377878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2c54b-08b1-481c-865b-43973812c8f4 None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:42.378299 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2c54b-08b1-481c-865b-43973812c8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:42.378659 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2c54b-08b1-481c-865b-43973812c8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:42.408381 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-eec2c54b-08b1-481c-865b-43973812c8f4 None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:42.409820 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eec2c54b-08b1-481c-865b-43973812c8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:42.480169 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1450/2893] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:42.492937 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8a1be-7eaf-445a-8c71-478261cfaedd service glance] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:42.494534 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-f6c8a1be-7eaf-445a-8c71-478261cfaedd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:42.581957 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8a1be-7eaf-445a-8c71-478261cfaedd service glance] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:42.587639 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03feb71-cf2b-4a04-b62f-765d5ba1787b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:42.588263 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03feb71-cf2b-4a04-b62f-765d5ba1787b service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:42.588545 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03feb71-cf2b-4a04-b62f-765d5ba1787b service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:42.588821 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03feb71-cf2b-4a04-b62f-765d5ba1787b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:42.598999 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03feb71-cf2b-4a04-b62f-765d5ba1787b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:42.601540 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03feb71-cf2b-4a04-b62f-765d5ba1787b service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:42.612765 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1444/2894] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:29:47.206870 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2c54b-08b1-481c-865b-43973812c8f4 None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:47.213266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-eec2c54b-08b1-481c-865b-43973812c8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:47.290622 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2c54b-08b1-481c-865b-43973812c8f4 None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:47.294480 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd690b7-8a83-42bf-bdec-071e046680a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:47.295112 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd690b7-8a83-42bf-bdec-071e046680a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:47.295391 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd690b7-8a83-42bf-bdec-071e046680a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:47.295664 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd690b7-8a83-42bf-bdec-071e046680a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:47.300639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-acd690b7-8a83-42bf-bdec-071e046680a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:47.376691 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd690b7-8a83-42bf-bdec-071e046680a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:47.378147 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd690b7-8a83-42bf-bdec-071e046680a9 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:47.389768 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1451/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:29:52.608453 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=38 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:52.634359 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26727-6f63-4430-8c99-e32a29a65838 None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:52.634649 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26727-6f63-4430-8c99-e32a29a65838 None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:52.634923 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec26727-6f63-4430-8c99-e32a29a65838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:52.659819 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-5ec26727-6f63-4430-8c99-e32a29a65838 None None] MFA Rules not processed for user `8c3666d4c24143a8b3f064ccfb38cad6`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:52.661448 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-5ec26727-6f63-4430-8c99-e32a29a65838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:52.671295 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1445/2896] 10.222.0.20 () {58 vars in 958 bytes} [Fri Aug 19 15:29:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:29:54.741341 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd690b7-8a83-42bf-bdec-071e046680a9 service neutron] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:54.743325 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-acd690b7-8a83-42bf-bdec-071e046680a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:54.759665 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd690b7-8a83-42bf-bdec-071e046680a9 service neutron] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:54.764345 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:54.764980 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:54.765262 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:54.765541 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] PATH_INFO: `/v3/users/62dd7c07c70e4ef9bfca2687a91e7adf` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:54.766696 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62dd7c07c70e4ef9bfca2687a91e7adf)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:54.768607 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:54.811928 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:54.814650 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62dd7c07c70e4ef9bfca2687a91e7adf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:54.822710 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62dd7c07c70e4ef9bfca2687a91e7adf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:54.839744 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62dd7c07c70e4ef9bfca2687a91e7adf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:54.847397 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62dd7c07c70e4ef9bfca2687a91e7adf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:54.848020 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62dd7c07c70e4ef9bfca2687a91e7adf'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:54.854049 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1452/2897] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:54 2022] DELETE /identity/v3/users/62dd7c07c70e4ef9bfca2687a91e7adf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:55.071885 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26727-6f63-4430-8c99-e32a29a65838 None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:55.086986 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec26727-6f63-4430-8c99-e32a29a65838 None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:55.161008 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:55.161669 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:55.161956 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:55.162302 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] PATH_INFO: `/v3/projects/05bfd79b092142a085d1c0acf8a8ccd6` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:55.163418 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bfd79b092142a085d1c0acf8a8ccd6)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:55.165615 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:55.219393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bfd79b092142a085d1c0acf8a8ccd6', 'request_id': 'req-f04097db-c174-402f-a8de-ad678c80d997'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.225814 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bfd79b092142a085d1c0acf8a8ccd6', 'request_id': 'req-f04097db-c174-402f-a8de-ad678c80d997'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.235351 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bfd79b092142a085d1c0acf8a8ccd6', 'request_id': 'req-f04097db-c174-402f-a8de-ad678c80d997'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.249469 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] The token cache is being invalidate because project 05bfd79b092142a085d1c0acf8a8ccd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:55.250102 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.250924 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-f04097db-c174-402f-a8de-ad678c80d997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.252432 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1446/2898] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:55 2022] DELETE /identity/v3/projects/05bfd79b092142a085d1c0acf8a8ccd6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:55.257189 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:55.258782 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:55.273083 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334ab99-3a1c-40bf-94ab-76ea59a6d586 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:55.336896 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:55.337548 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:55.337825 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:55.338265 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] PATH_INFO: `/v3/users/ae06a907710b476e8dd9a0b26fd064da` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:55.339452 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae06a907710b476e8dd9a0b26fd064da)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:55.341366 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:55.389044 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc68a95-179c-4d48-94b1-740c8fc3f4cd None None] REQUEST_METHOD: `POST` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:55.389323 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc68a95-179c-4d48-94b1-740c8fc3f4cd None None] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:55.389776 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc68a95-179c-4d48-94b1-740c8fc3f4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:55.399979 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae06a907710b476e8dd9a0b26fd064da'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.407579 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae06a907710b476e8dd9a0b26fd064da'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.410417 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.auth.core [None req-cbc68a95-179c-4d48-94b1-740c8fc3f4cd None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81450) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:29:55.411635 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cbc68a95-179c-4d48-94b1-740c8fc3f4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:55.421490 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae06a907710b476e8dd9a0b26fd064da'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.430221 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae06a907710b476e8dd9a0b26fd064da'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.431252 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae06a907710b476e8dd9a0b26fd064da'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.439369 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1453/2899] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:29:55 2022] DELETE /identity/v3/users/ae06a907710b476e8dd9a0b26fd064da => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:29:55.483576 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1447/2900] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Aug 19 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 15:29:55.496731 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:55.499257 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:55.550752 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:55.586915 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c09669-4b8d-430c-9975-a627f5879a09 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:55.593529 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757887-4777-4a1b-a7be-d1ae191ffc7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:55.594657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757887-4777-4a1b-a7be-d1ae191ffc7e service swift] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:55.594657 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757887-4777-4a1b-a7be-d1ae191ffc7e service swift] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:55.594850 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757887-4777-4a1b-a7be-d1ae191ffc7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:55.651304 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc68a95-179c-4d48-94b1-740c8fc3f4cd None None] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:29:55.654398 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-cbc68a95-179c-4d48-94b1-740c8fc3f4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:29:55.673431 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc68a95-179c-4d48-94b1-740c8fc3f4cd None None] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:29:55.679831 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757887-4777-4a1b-a7be-d1ae191ffc7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:55.681438 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757887-4777-4a1b-a7be-d1ae191ffc7e service swift] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:55.693347 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1454/2901] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:29:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 19 15:29:55.715095 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:29:55.793620 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:29:55.794804 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:29:55.795853 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:29:55.796245 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] PATH_INFO: `/v3/projects/48aec5a397b9496fbb938745d25e96ad` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:29:55.797656 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=48aec5a397b9496fbb938745d25e96ad)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:29:55.801210 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:29:55.901603 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48aec5a397b9496fbb938745d25e96ad', 'request_id': 'req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.911345 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48aec5a397b9496fbb938745d25e96ad', 'request_id': 'req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.933425 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48aec5a397b9496fbb938745d25e96ad', 'request_id': 'req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.949827 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] The token cache is being invalidate because project 48aec5a397b9496fbb938745d25e96ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:29:55.950169 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.951192 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:29:55.955059 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1448/2902] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:29:55 2022] DELETE /identity/v3/projects/48aec5a397b9496fbb938745d25e96ad => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:30:05.688698 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=36 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:30:05.944039 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:30:18.798436 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757887-4777-4a1b-a7be-d1ae191ffc7e service swift] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:30:18.799878 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-82757887-4777-4a1b-a7be-d1ae191ffc7e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:30:18.889351 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757887-4777-4a1b-a7be-d1ae191ffc7e service swift] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:30:18.945894 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69058e0d-6852-44f5-833d-1e6f47283041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a220cf4fafe84d6498bc959a9cd18df7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:30:18.946524 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69058e0d-6852-44f5-833d-1e6f47283041 service neutron] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:30:18.946803 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69058e0d-6852-44f5-833d-1e6f47283041 service neutron] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:30:18.947077 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69058e0d-6852-44f5-833d-1e6f47283041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:30:18.948794 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-69058e0d-6852-44f5-833d-1e6f47283041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:30:19.042986 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69058e0d-6852-44f5-833d-1e6f47283041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:30:19.044402 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69058e0d-6852-44f5-833d-1e6f47283041 service neutron] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:30:19.054236 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1455/2903] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:30:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:30:29.050127 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=96 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:10.083319 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:31:10.084717 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:31:10.196929 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118415c1-e39a-4ed9-b7f4-d0bd0fa9e7ce admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:31:10.202068 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594cc4-f75d-4cb2-8309-56e4e6b50e7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2862a661174142d69bbdd54ee0289681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:31:10.202673 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594cc4-f75d-4cb2-8309-56e4e6b50e7f service placement] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:31:10.202951 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594cc4-f75d-4cb2-8309-56e4e6b50e7f service placement] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:31:10.203222 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594cc4-f75d-4cb2-8309-56e4e6b50e7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:31:10.205100 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a9594cc4-f75d-4cb2-8309-56e4e6b50e7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:31:10.218412 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9594cc4-f75d-4cb2-8309-56e4e6b50e7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:31:10.220010 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9594cc4-f75d-4cb2-8309-56e4e6b50e7f service placement] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:31:10.230346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1449/2904] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:31:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:31:20.225864 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=52 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:42.434129 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ae53-a513-4509-a2a7-5d0910a1337f None None] REQUEST_METHOD: `POST` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:31:42.434606 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ae53-a513-4509-a2a7-5d0910a1337f None None] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:31:42.434707 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ae53-a513-4509-a2a7-5d0910a1337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:31:42.464185 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.auth.core [None req-26c8ae53-a513-4509-a2a7-5d0910a1337f None None] MFA Rules not processed for user `8e2cfbdc26484ae68545115f9751d482`. Rule list: `[]` (Enabled: `True`). {{(pid=81449) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 15:31:42.465375 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-26c8ae53-a513-4509-a2a7-5d0910a1337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:31:42.527511 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1456/2905] 10.222.0.20 () {58 vars in 967 bytes} [Fri Aug 19 15:31:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 15:31:42.567947 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594cc4-f75d-4cb2-8309-56e4e6b50e7f service placement] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:31:42.569369 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-a9594cc4-f75d-4cb2-8309-56e4e6b50e7f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:31:42.637667 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594cc4-f75d-4cb2-8309-56e4e6b50e7f service placement] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:31:42.642703 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a188d-6ac1-4ed0-8ff9-f27c803a98c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62c25756d0814f1dbb8ca210ae34c892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:31:42.643301 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a188d-6ac1-4ed0-8ff9-f27c803a98c0 service swift] REQUEST_METHOD: `GET` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:31:42.643583 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a188d-6ac1-4ed0-8ff9-f27c803a98c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:31:42.643961 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a188d-6ac1-4ed0-8ff9-f27c803a98c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:31:42.651901 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a188d-6ac1-4ed0-8ff9-f27c803a98c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:31:42.653468 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a188d-6ac1-4ed0-8ff9-f27c803a98c0 service swift] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:31:42.661339 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1450/2906] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Aug 19 15:31:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 15:31:49.200483 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8ae53-a513-4509-a2a7-5d0910a1337f None None] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:31:49.202766 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-26c8ae53-a513-4509-a2a7-5d0910a1337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:31:49.305058 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8ae53-a513-4509-a2a7-5d0910a1337f None None] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:31:49.310323 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:31:49.310954 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:31:49.311233 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:31:49.311505 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] PATH_INFO: `/v3/users/8c3666d4c24143a8b3f064ccfb38cad6` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:31:49.312729 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3666d4c24143a8b3f064ccfb38cad6)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:31:49.314784 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:31:49.367567 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3666d4c24143a8b3f064ccfb38cad6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.375053 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3666d4c24143a8b3f064ccfb38cad6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.380134 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:49.387955 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3666d4c24143a8b3f064ccfb38cad6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.395576 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3666d4c24143a8b3f064ccfb38cad6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.396319 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3666d4c24143a8b3f064ccfb38cad6'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.402715 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1457/2907] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:31:49 2022] DELETE /identity/v3/users/8c3666d4c24143a8b3f064ccfb38cad6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:31:49.576442 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a188d-6ac1-4ed0-8ff9-f27c803a98c0 service swift] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:31:49.591983 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a188d-6ac1-4ed0-8ff9-f27c803a98c0 service swift] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:31:49.653566 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:31:49.654221 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:31:49.654500 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:31:49.654770 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] PATH_INFO: `/v3/projects/56262b33989d4c3ba1c8811118bab9c8` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:31:49.655863 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=56262b33989d4c3ba1c8811118bab9c8)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:31:49.657744 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:31:49.703679 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56262b33989d4c3ba1c8811118bab9c8', 'request_id': 'req-099526d1-9e67-49ce-871a-ad16751817ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.709139 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56262b33989d4c3ba1c8811118bab9c8', 'request_id': 'req-099526d1-9e67-49ce-871a-ad16751817ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.716393 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56262b33989d4c3ba1c8811118bab9c8', 'request_id': 'req-099526d1-9e67-49ce-871a-ad16751817ca'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.727265 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] The token cache is being invalidate because project 56262b33989d4c3ba1c8811118bab9c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:31:49.727560 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.728188 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.730159 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1451/2908] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:31:49 2022] DELETE /identity/v3/projects/56262b33989d4c3ba1c8811118bab9c8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:31:49.734121 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:31:49.735545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:31:49.748780 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdccca41-5808-4190-8c43-165fee2a0bdb admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:31:49.802651 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:31:49.803266 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:31:49.803545 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:31:49.803814 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] PATH_INFO: `/v3/users/44a5836d91a54722b86d88f4a79ca60f` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:31:49.804934 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a5836d91a54722b86d88f4a79ca60f)` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:31:49.806860 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:31:49.856989 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a5836d91a54722b86d88f4a79ca60f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.863787 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a5836d91a54722b86d88f4a79ca60f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.876270 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a5836d91a54722b86d88f4a79ca60f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.883456 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a5836d91a54722b86d88f4a79ca60f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.884062 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.notifications [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a5836d91a54722b86d88f4a79ca60f'} {{(pid=81449) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:49.889830 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1458/2909] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Aug 19 15:31:49 2022] DELETE /identity/v3/users/44a5836d91a54722b86d88f4a79ca60f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:31:50.060868 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] Authenticating user token {{(pid=81450) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:31:50.062618 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.fernet_utils [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81450) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:31:50.080335 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099526d1-9e67-49ce-871a-ad16751817ca admin admin] Validating token access rules against request {{(pid=81450) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:31:50.098974 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:31:50.142687 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9828bdee3ea64cec99e58fcb117e4cdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c58200470045b79a04ba5897774f1b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81450) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:31:50.143346 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:31:50.143626 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] SCRIPT_NAME: `/identity` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:31:50.143896 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] PATH_INFO: `/v3/projects/8c73faf0859f48f695cd75d8ca0e83bc` {{(pid=81450) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:31:50.145013 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c73faf0859f48f695cd75d8ca0e83bc)` {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:31:50.146979 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] RBAC: Authorization granted {{(pid=81450) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:31:50.192869 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c73faf0859f48f695cd75d8ca0e83bc', 'request_id': 'req-776eef00-9516-4da2-8b29-4e1f734400df'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:50.198236 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c73faf0859f48f695cd75d8ca0e83bc', 'request_id': 'req-776eef00-9516-4da2-8b29-4e1f734400df'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:50.206472 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c73faf0859f48f695cd75d8ca0e83bc', 'request_id': 'req-776eef00-9516-4da2-8b29-4e1f734400df'} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:50.220023 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] The token cache is being invalidate because project 8c73faf0859f48f695cd75d8ca0e83bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81450) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 15:31:50.220589 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:50.221249 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG keystone.notifications [None req-776eef00-9516-4da2-8b29-4e1f734400df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81450) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 15:31:50.222772 dv-cinder-835384-20-smb devstack@keystone.service[81450]: [pid: 81450|app: 0|req: 1452/2910] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Aug 19 15:31:50 2022] DELETE /identity/v3/projects/8c73faf0859f48f695cd75d8ca0e83bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 15:31:59.886497 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=59,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:32:00.216237 dv-cinder-835384-20-smb devstack@keystone.service[81450]: DEBUG dbcounter [-] [81450] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 15:36:15.073465 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] Authenticating user token {{(pid=81449) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 15:36:15.074883 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:36:15.143018 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3003fd6-b49c-44cb-b132-93c08acf5cd2 admin admin] Validating token access rules against request {{(pid=81449) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 15:36:15.201469 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613bd15-1de1-485b-8d3c-3da23ab835b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2862a661174142d69bbdd54ee0289681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b20bcabf64f4a1e836faac13a949278', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81449) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 15:36:15.202105 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613bd15-1de1-485b-8d3c-3da23ab835b3 service placement] REQUEST_METHOD: `GET` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 15:36:15.202392 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613bd15-1de1-485b-8d3c-3da23ab835b3 service placement] SCRIPT_NAME: `/identity` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 15:36:15.202666 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613bd15-1de1-485b-8d3c-3da23ab835b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81449) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 15:36:15.204434 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.fernet_utils [None req-d613bd15-1de1-485b-8d3c-3da23ab835b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81449) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 15:36:15.215639 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613bd15-1de1-485b-8d3c-3da23ab835b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 15:36:15.217143 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613bd15-1de1-485b-8d3c-3da23ab835b3 service placement] RBAC: Authorization granted {{(pid=81449) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 15:36:15.227304 dv-cinder-835384-20-smb devstack@keystone.service[81449]: [pid: 81449|app: 0|req: 1459/2911] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Aug 19 15:36:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 15:36:25.222979 dv-cinder-835384-20-smb devstack@keystone.service[81449]: DEBUG dbcounter [-] [81449] Writing DB stats keystone:SELECT=58 {{(pid=81449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}